-- Logs begin at Thu 2022-07-21 22:45:53 UTC, end at Thu 2022-07-21 23:54:35 UTC. -- Jul 21 23:29:43.477703 dv-cinder-850700-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 23:29:43.486589 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 23:29:43.488550 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 23:29:43 2022] *** Jul 21 23:29:43.488550 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 23:29:43.488550 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 23:29:43.488550 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: nodename: dv-cinder-850700-1-iscsi Jul 21 23:29:43.488550 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: machine: x86_64 Jul 21 23:29:43.488550 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: clock source: unix Jul 21 23:29:43.488550 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: pcre jit disabled Jul 21 23:29:43.488550 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: detected number of CPU cores: 4 Jul 21 23:29:43.488550 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: current working directory: / Jul 21 23:29:43.488550 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: detected binary path: /usr/bin/uwsgi-core Jul 21 23:29:43.489239 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: your processes number limit is 47680 Jul 21 23:29:43.489239 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: your memory page size is 4096 bytes Jul 21 23:29:43.489239 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: detected max file descriptor number: 2048 Jul 21 23:29:43.489239 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: lock engine: pthread robust mutexes Jul 21 23:29:43.489239 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: thunder lock: enabled Jul 21 23:29:43.489239 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 23:29:43.489239 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 23:29:43.532764 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: Python main interpreter initialized at 0x563c1473e9c0 Jul 21 23:29:43.532764 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: python threads support enabled Jul 21 23:29:43.532764 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: your server socket listen backlog is limited to 100 connections Jul 21 23:29:43.532764 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: your mercy for graceful operations on workers is 90 seconds Jul 21 23:29:43.533106 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 23:29:43.533180 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: *** Operational MODE: preforking *** Jul 21 23:29:43.533435 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: *** uWSGI is running in multiple interpreter mode *** Jul 21 23:29:43.533435 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: spawned uWSGI master process (pid: 103460) Jul 21 23:29:43.533617 dv-cinder-850700-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 23:29:43.534954 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: spawned uWSGI worker 1 (pid: 103461, cores: 1) Jul 21 23:29:43.534954 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: spawned uWSGI worker 2 (pid: 103462, cores: 1) Jul 21 23:29:43.534954 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 23:29:44.185626 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 23:29:44.210054 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 23:29:45.309821 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:29:45.309821 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: from cryptography.utils import int_from_bytes Jul 21 23:29:45.310476 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:29:45.310476 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: from cryptography.utils import int_from_bytes Jul 21 23:29:45.330233 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:29:45.330233 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: from cryptography.utils import int_from_bytes Jul 21 23:29:45.330688 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:29:45.330688 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: from cryptography.utils import int_from_bytes Jul 21 23:29:47.820313 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 23:29:47.820876 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 23:29:47.821076 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 23:29:47.821452 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 23:29:47.821709 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 23:29:47.822093 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.822418 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.822736 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.823051 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.823379 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.823686 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.824005 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.824317 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.824642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.824886 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 23:29:47.825293 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.825389 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 23:29:47.825471 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.825547 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850700-1-iscsi {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.825668 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 23:29:47.825844 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.826028 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 23:29:47.826151 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.826280 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 23:29:47.826459 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.826660 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.826769 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.826984 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.827152 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.827304 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.827406 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.827620 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.827715 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.827947 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.828128 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.828256 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.829293 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.829446 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.829567 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.829656 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.829735 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.829819 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.829819 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.830022 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.830118 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.830257 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.830346 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850700-1-iscsi {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.830431 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.830518 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.830597 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.830803 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.830888 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.830965 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.831097 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.831246 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.831382 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.831550 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.831681 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850700-1-iscsi {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.831870 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.832012 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.832174 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.832295 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.832607 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.832690 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.832961 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.833099 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.833294 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.833393 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.833611 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.833763 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.833927 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.834029 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.834254 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.834917 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.835156 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.835490 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.835598 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.835810 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.835898 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.836140 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.836238 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.836445 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.836531 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.836746 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.836831 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.837051 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.837199 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850700-1-iscsi {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.837382 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.837522 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.837697 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.837834 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.838001 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.838147 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.838301 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.838546 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.838631 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.838851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.838939 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.839154 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.839240 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.839472 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.839570 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.839789 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.839929 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.840027 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.840106 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.840265 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.840411 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.840581 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.840708 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.840898 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.841029 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.841219 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.841372 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.841527 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.841674 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.841832 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.841981 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.842135 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.842285 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.842437 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.842599 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.842738 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.842902 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.843040 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.843204 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.843342 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.843436 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.843656 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.843756 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.843965 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.844062 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.844283 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.844412 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.844585 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.844694 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.844880 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.844974 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.845127 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.845305 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.845471 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.845575 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.845790 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.845883 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.846097 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.846188 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.846402 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.846495 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.846707 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.846801 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.847011 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.847097 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.847318 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.847405 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.847622 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.847707 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.847925 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.848011 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.848223 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.848312 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.848535 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.848629 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.848846 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.848941 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.849145 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.849245 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.849417 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.849502 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.849717 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.849815 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.850649 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.851088 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.851365 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.851461 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.851624 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.851720 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.851936 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.852024 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.852266 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.852357 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.852572 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.852668 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.852876 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.852962 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.853246 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.853358 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.853506 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.853608 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.853809 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.853896 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.854111 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.854197 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.854416 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.854552 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.854721 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.854808 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.855025 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.855112 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.855340 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.855437 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.855590 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.855677 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.855889 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.855975 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.856192 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.856287 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.856509 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.856596 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.856811 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.856896 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.857112 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.857226 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.857446 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.857533 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.857740 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.857824 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.858043 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.858130 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.858347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.858433 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.858646 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.858731 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.858952 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.859045 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.859253 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.859337 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.859552 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.859650 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.859857 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.859943 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.860153 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.860237 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.860453 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.860545 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.860766 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.860851 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.861070 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.861165 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.861400 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.861506 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.861702 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.861788 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.862001 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.862093 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.862301 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.862395 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.862599 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.862693 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.862899 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.862985 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.863198 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.863292 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.863493 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.863579 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.863805 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.863897 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.864108 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.864203 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.864412 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.864499 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.864711 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.864799 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.865011 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.865096 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.865347 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.865480 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.865813 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.865940 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.866196 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.866463 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.866551 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.866785 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.866871 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.867094 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.867193 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.867401 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.867489 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.867707 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.867793 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.868010 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.868105 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.868313 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.868405 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.868618 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.868711 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.868919 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.869012 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.869248 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.869336 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.869567 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.869685 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.869883 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.869976 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.870200 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.870287 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.870502 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.870587 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.870810 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.870963 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.871116 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.871254 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.871422 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:29:47.871566 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.871713 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.871847 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.872024 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.872167 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.872350 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.872498 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.872668 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.872812 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.872976 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.873128 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.873353 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.873467 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.873653 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.873749 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.873979 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.874072 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.874278 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.874378 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.874622 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.874713 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.874915 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.875017 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.875226 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.875321 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.875538 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.875638 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.875852 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.875948 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.876182 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.876284 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.876479 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.876579 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.876792 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.876898 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.877115 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.877244 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.877434 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.877522 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.877741 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.877827 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.878046 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.878132 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.878357 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.878443 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.878671 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.878764 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.879233 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.879325 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.879543 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.879632 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.879853 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.879955 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.880167 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.880269 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.880476 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.880571 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.880784 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.880891 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.881094 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.881272 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.881472 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.881780 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.881948 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.882078 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.882267 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.882384 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.882593 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.882680 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.882925 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.883021 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.883239 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.883325 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.883558 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.883644 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.883871 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.883974 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.884184 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.884277 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.884490 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.884575 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.884793 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.884887 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.885098 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.885210 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.885425 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.885513 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.885737 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.885838 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.886043 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.886130 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.886344 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.886431 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.886658 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.886758 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.886963 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.887049 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.887265 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.887354 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.887568 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.887672 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.887871 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.887958 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.888168 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.888253 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.888468 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.888561 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.888776 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.888935 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.889078 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.889230 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.889402 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.889493 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.889714 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.889816 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.890022 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.890126 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.890333 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.890427 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.890642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.890738 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.890953 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.891056 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.891262 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.891411 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.891568 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.891704 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.891872 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.892017 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.892183 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.892325 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.892493 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.892627 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.892793 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.892941 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.893083 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.893240 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.893410 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.893497 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.893715 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.893809 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.894018 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.894104 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.894321 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.894406 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.894620 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.894714 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.894922 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.895009 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.895226 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.895313 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.895528 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.895615 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.895829 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.895930 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.896134 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.896219 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.896439 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.896526 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.896739 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.897337 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.897635 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.897939 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.898116 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.898280 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.898461 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.898585 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.898795 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.898921 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.899105 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.899252 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.899432 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.899568 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.899759 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.899902 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.900077 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.900173 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.900380 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.900473 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.900690 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.900784 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.900992 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.901085 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.901328 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.901430 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.901633 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.901728 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.901942 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.902032 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.902247 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.902334 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.902550 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.902644 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.902852 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.902945 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.903152 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.903238 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.903454 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.903542 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.903774 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.903859 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.904077 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.904171 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.904378 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.904467 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.904680 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.904766 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.904980 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.905075 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.905346 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.905444 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.905652 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.905738 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.905970 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.906066 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.906282 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.906369 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.906591 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.906678 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.906899 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.906999 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.907206 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.907293 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.907512 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.907604 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.907818 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.907912 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.908121 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.908216 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.908426 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.908511 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.908731 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.908819 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.909045 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.909130 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.909372 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.909467 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.909686 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.909773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.909982 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.910075 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.910291 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.910384 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.910598 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.910729 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.910916 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.911020 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.911218 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.911322 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.911527 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.911622 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.911840 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.911926 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.912146 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.912234 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.912511 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.912825 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.913129 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.913457 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.913767 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.913867 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.914079 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.914195 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.914386 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.914518 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.914691 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.914842 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.914992 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.915166 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.915318 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.915484 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.915615 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.915800 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.915934 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.916116 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.916248 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.916435 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.916578 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.916731 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.916865 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.917053 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.917210 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.917392 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.917492 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.917708 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.917793 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.918011 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.918106 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.918313 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.918408 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.918612 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.918698 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.918924 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.919012 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.919222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.919317 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.919526 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.919620 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.919828 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.919915 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.920154 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.920257 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.920458 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.920544 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.920760 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.920846 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.921063 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.921150 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.921399 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.921563 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.921705 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.921793 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.922004 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.922091 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.922307 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.922393 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.922614 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.922700 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.922917 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.923011 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.923224 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.923309 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.923523 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.923614 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.923827 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.923913 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.924130 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.924215 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.924431 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.924525 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.924727 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.924819 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.925035 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.925129 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.925361 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.925465 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.925667 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.925761 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.925976 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.926113 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.926279 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.926375 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.926579 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.926664 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.926879 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.926974 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.927196 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.927440 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.927528 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.927767 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.927854 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.928620 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.928876 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.929005 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.929472 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.929563 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.929795 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.929882 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.930116 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.930203 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.930424 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.930510 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.930745 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.930831 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.931055 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.931153 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.931363 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.931450 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.931669 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.931756 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.931972 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.932074 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.932274 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.932359 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.932571 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.932657 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.932874 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.932968 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.933174 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.933275 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.933500 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.933587 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.933802 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.933901 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.934100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.934194 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.934400 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.934486 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.934698 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.934786 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.935005 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.935091 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.935302 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.935434 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.935606 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.935693 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.935902 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.935988 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.936205 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.936290 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.936518 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.936606 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.936820 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.937077 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.937162 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.937437 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.937536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.937750 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.937835 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.938064 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.938149 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.938378 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.938464 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.938695 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.938781 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.939026 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.939111 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.939324 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.939417 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.939625 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.939711 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.939945 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.940041 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.940245 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.940344 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.940545 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.940629 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.940840 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.940926 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.941144 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.941261 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.941474 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.941560 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.941771 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.941871 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.942068 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.942163 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.942369 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.942455 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.942673 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.942758 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.942975 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.943069 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.943271 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.943369 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.943568 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.943662 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.944073 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.944375 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.944462 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.944682 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.944766 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.944985 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.945083 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.945314 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.945408 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.945624 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.945713 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.945930 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.946065 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.946230 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.946323 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.946538 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.946624 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.946833 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.946926 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.947145 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.947231 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.947446 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.947533 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.947747 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.947835 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.948049 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.948141 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.948356 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.948441 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.948661 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.948755 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.948961 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.949047 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.949314 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.949413 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.949620 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.949707 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.949935 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.950023 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.950232 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.950326 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.950543 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.950639 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.950854 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.950972 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.951156 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.951263 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.951464 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.951560 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.951775 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.951883 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.952082 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.952177 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.952385 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.952478 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.952688 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.952774 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.952986 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.953084 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.953310 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.953411 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.953611 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.953697 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.953915 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.954008 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.954211 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.954296 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.954509 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.954595 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.954805 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.954892 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.955105 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.955191 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.955403 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.955495 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.955715 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.955811 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.956015 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.956108 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.956315 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.956401 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.956615 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.956701 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.956911 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.957004 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.957522 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.957631 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.957714 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.957793 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.957878 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.957957 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.958115 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.958212 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.958436 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.958522 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.958744 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.958831 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.959047 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.959142 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.959966 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.960064 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.960285 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.960425 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.960589 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.960758 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.960899 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.961095 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.961223 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.961459 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.961555 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.961809 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.961937 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.962110 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.962205 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.962429 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.962527 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.962738 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.962825 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.963044 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.963130 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.963362 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.963524 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.963675 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.963769 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.963993 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.964085 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.964293 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.964388 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.964598 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.964684 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.964906 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.964991 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.965228 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.965331 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.965537 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.965630 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.965846 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.965942 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.966153 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.966240 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.966459 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.966544 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.966763 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.966856 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.967070 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.967156 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.967374 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.967464 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.967677 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.967763 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.967983 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.968071 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.968290 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.968376 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.968591 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.968676 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.968911 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.969005 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.969238 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.969339 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.969542 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.969636 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.969849 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.969935 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.970152 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.970245 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.970460 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.970555 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.970763 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.970865 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.971091 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.971176 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.971400 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.971495 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.971708 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.971800 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.972033 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.972119 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.972346 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.972447 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.972651 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.972736 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.972964 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.973050 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.973298 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.973388 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.973603 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.973701 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.973917 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.974009 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.974230 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.974325 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.974545 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.974631 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.974857 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.975557 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.975746 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.975880 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.976050 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.976197 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.976348 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.976520 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.976666 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.976837 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.976975 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.977154 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.977299 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.977497 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.977586 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.977813 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.977900 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.978121 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.978208 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.978438 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.978525 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.978751 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.978896 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.979060 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.979207 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.979386 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.979512 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.979699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.979923 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.980010 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.980234 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.980329 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.980541 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.980627 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.980863 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.980958 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.981214 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.981315 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.981527 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.981619 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.981830 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.981922 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.982143 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.982230 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.982450 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.982544 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.982772 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.982859 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.983093 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.983191 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.983403 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.983489 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.983711 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.983796 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.984011 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.984097 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.984332 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.984420 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.984653 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.984760 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.984963 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.985050 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.985306 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.985396 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.985627 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.985725 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.985933 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.986020 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.986245 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.986332 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.986571 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.986705 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.986876 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.986982 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.987183 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.987332 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.987487 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.987582 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.987810 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.987906 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.988110 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.988204 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.988417 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.988504 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.988739 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.988872 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.989043 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.989130 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.989377 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.989467 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.989687 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.989840 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.989994 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.990183 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.990298 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.990453 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.990623 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.990948 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.991035 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.991252 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.991347 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.991574 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.991674 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.991886 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.991973 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.992206 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.992293 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.992525 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.992622 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.992829 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.992916 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.993149 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.993256 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.993480 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.993570 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.993782 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.993869 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.994086 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.994173 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.994386 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.994473 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.994720 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.994812 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.995020 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.995105 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.995336 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.995424 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.995661 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.995749 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.995982 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.996070 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.996291 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.996379 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.996620 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.996708 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.996950 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.997055 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.997284 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.997386 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.997592 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.997681 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.997901 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.997998 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.998208 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.998295 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.998515 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.998604 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.998832 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.998927 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.999133 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.999219 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.999434 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.999519 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.999734 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:47.999829 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.000038 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.000125 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.000335 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.000420 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.000634 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.000723 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.000935 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.001023 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.001268 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.001400 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.001573 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.001674 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.001892 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.001990 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.002195 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.002306 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.002497 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.002595 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.002800 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.002895 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.003101 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.003188 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.003411 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.003506 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.003715 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.003802 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.004273 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.004373 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.004576 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.004663 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.004897 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.004992 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.005230 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.005333 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.005548 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.005643 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.005868 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.005954 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.006207 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.006307 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.006524 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.006646 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.006844 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.006936 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.007156 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.007263 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.007473 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.007559 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.007782 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.007869 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.008094 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.008183 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.008398 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.008484 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.008706 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.008793 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.009015 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.009166 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.009348 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.009436 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.009657 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.009865 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.009962 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.010193 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.010281 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.010509 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.010636 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.010822 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.010987 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.011133 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.011222 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.011445 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.011532 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.011749 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.011844 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.012055 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.012141 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.012364 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.012451 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.012667 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.012762 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.012970 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.013056 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.013297 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.013387 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.013625 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.013713 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.013945 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.014083 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.014271 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.014367 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.014586 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.014682 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.014901 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.014988 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.015215 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.015313 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.015522 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.015608 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.015849 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.015944 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.016168 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.016301 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.016473 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.016568 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.016786 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.016873 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.017099 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.017240 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.017432 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.017518 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.017742 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.017829 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.018052 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.018143 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.018358 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.018452 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.018666 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.018760 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.018976 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.019072 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.019283 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.019370 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.019593 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.019807 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.019896 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.020137 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.020224 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.020457 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.020550 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.020773 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.020871 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.021087 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.021175 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.021429 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.021536 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.022261 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.022361 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.022699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.022870 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.023218 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.023308 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.023542 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.023670 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.023861 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.023950 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.024200 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.024331 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.024524 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.024640 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.024853 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.024967 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.025180 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.025339 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.025521 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.025691 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.025810 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.025934 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.026124 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.026257 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.026438 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.026558 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.026721 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.026842 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.027050 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.027186 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.027356 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.027480 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.027660 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.027775 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.027978 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.028094 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.028287 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.028423 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.028597 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.028822 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.028944 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.029169 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.029350 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.029535 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.029694 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.029840 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.029929 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.030155 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.030243 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.030468 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.030554 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.030772 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.030868 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.031094 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.031177 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.031396 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.031490 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.031700 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.031789 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.032013 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.032099 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.032319 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.032415 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.032621 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.032708 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.032922 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.033158 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.033312 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.033501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.033591 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.033834 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.033953 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.034140 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.034257 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.034441 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.034558 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.034763 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.034877 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.035067 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.035194 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.035366 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.035492 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.035666 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.035790 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.035974 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.036114 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.036271 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.036402 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.036572 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.036688 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.036874 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.037003 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.037170 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.037349 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.038114 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.038240 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.038462 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.038605 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.038785 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.038909 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.039101 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.039245 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.039456 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.039636 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.039760 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.039988 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.040076 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.040314 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.040410 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.040645 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.040738 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.040973 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.041060 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.041308 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.041413 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.041617 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.041704 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.041925 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.042011 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.042235 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.042331 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.042542 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.042629 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.042854 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.042949 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.043163 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.043258 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.043470 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.043593 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.043775 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.044017 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.044150 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.044348 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.044466 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.044668 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.044795 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.044977 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.045111 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.045303 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.045429 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.045619 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.045733 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.045927 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.046090 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.046213 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.046323 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.046518 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.046633 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.046828 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.046943 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.047131 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.047254 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.047437 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.047561 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.047740 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.047868 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.048045 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.048169 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.048353 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.048514 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.048687 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.048770 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.048942 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.049030 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.049266 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.049357 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.049576 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.049672 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.049876 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.049963 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.050181 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.050287 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.050485 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.050573 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.050792 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.050880 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.051127 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.051228 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.051427 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.051523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.051742 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.051829 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.052049 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.052145 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.052357 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.052443 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.052667 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.052791 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.052973 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.053123 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.053385 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.053578 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.053708 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.053911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.054048 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.054308 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.054436 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.054619 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.054772 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.054923 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.055095 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.055339 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.055458 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.055647 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.055771 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.055962 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.056087 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.056279 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.056405 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.056586 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.056788 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.056926 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.057049 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.057246 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.057378 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.057547 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.057699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.057857 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.057947 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.058164 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.058258 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.058471 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.058558 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.058783 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.058872 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.059094 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.059182 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.059405 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.059503 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.059712 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.059806 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.060014 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.060101 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.060316 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.060411 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.060623 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.060710 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.060933 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.061019 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.061265 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.061365 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.061569 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.061665 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.061867 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.061956 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.062172 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.062268 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.062472 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.062560 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.062775 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.062864 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.063075 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.063164 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.063373 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.063467 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.063677 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.063765 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.063974 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.064070 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.064272 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.064359 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.064570 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.064657 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.064868 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.064957 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.065167 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.065285 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.065485 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.065617 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.065790 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.065930 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.066089 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.066249 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.066389 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.066571 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.066694 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.066884 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.066995 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.067207 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.067302 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.067530 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.067619 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.067845 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.067933 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.068167 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.068262 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.068478 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.068565 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.069361 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.069453 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.069728 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.069826 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.070059 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.070146 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.070427 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.070528 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.070688 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.070824 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.070996 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.071087 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.071299 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.071393 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.071607 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.071703 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.071921 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.072015 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.072229 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.072316 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.072532 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.072655 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.072833 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.072919 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.073134 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.073310 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.073467 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.073556 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.073776 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.073863 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.074081 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.074167 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.074385 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.074480 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.074691 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.074778 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.074995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.075091 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.075298 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.075387 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.075601 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.075689 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.075905 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.076001 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.076205 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.076291 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.076511 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.076642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.076822 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.076931 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.077121 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.077457 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.077546 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.077759 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.077929 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.078064 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.078152 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.078368 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.078461 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.078678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.078767 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.078991 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.079085 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.079305 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.079392 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.079624 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.079713 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.079936 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.080031 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.080241 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.080334 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.080554 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.080642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.080875 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.081007 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.081231 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.081321 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.081533 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.081623 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.081844 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.081941 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.082178 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.082280 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.082485 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.082572 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.082793 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.082887 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.083093 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.083188 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.083359 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 23:29:48.083456 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.083696 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.084008 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.085003 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.085375 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.085691 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.086022 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.086345 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.086670 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.086995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.087314 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.087647 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.087965 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.088280 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.088594 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.088913 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.089250 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.089575 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.089890 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.090206 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.090527 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.090853 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.091184 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.091515 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.091829 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.092225 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.092488 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.092852 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.093150 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.093524 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.093854 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.094172 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.094487 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.094797 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:29:48.095038 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 23:29:48.144684 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] Registered counter for database nova_api Jul 21 23:29:48.156823 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO dbcounter [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Registered counter for database nova_api Jul 21 23:29:48.259590 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:29:48.266039 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:29:48.268758 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_db.sqlalchemy.engines [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:29:48.275659 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writer thread running {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:29:48.321982 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.context [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4f2fb103-b053-4673-9a59-2784203907e0(cell1) {{(pid=103462) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 23:29:48.325859 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:29:48.327436 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:29:48.328220 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:29:48.330373 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:29:48.331366 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.context [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4f2fb103-b053-4673-9a59-2784203907e0(cell1) {{(pid=103461) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 23:29:48.332328 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] Registered counter for database nova_cell0 Jul 21 23:29:48.335868 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:29:48.336804 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] Registered counter for database nova_cell1 Jul 21 23:29:48.337469 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:29:48.338265 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:29:48.340365 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:29:48.342386 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO dbcounter [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Registered counter for database nova_cell0 Jul 21 23:29:48.344033 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:29:48.345978 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:29:48.346388 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO dbcounter [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Registered counter for database nova_cell1 Jul 21 23:29:48.352173 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:29:48.353477 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:29:48.353703 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_db.sqlalchemy.engines [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:29:48.358585 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writer thread running {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:29:48.359216 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_db.sqlalchemy.engines [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:29:48.505220 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] Registered counter for database nova_cell0 Jul 21 23:29:48.506903 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writer thread running {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:29:48.515253 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:29:48.515862 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO dbcounter [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Registered counter for database nova_cell0 Jul 21 23:29:48.519548 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:29:48.525165 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_db.sqlalchemy.engines [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:29:48.529412 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writer thread running {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:29:48.859052 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: WARNING keystonemiddleware.auth_token [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 23:29:48.862736 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 23:29:48.866645 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: WARNING keystonemiddleware.auth_token [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 23:29:48.870649 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 23:29:49.213805 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: WARNING keystonemiddleware.auth_token [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 23:29:49.219694 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: WARNING keystonemiddleware.auth_token [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 23:29:49.222532 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 23:29:49.225070 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563c1473e9c0 pid: 103461 (default app) Jul 21 23:29:49.227132 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:29:49.228306 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001712 Jul 21 23:29:49.228711 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Thu Jul 21 23:29:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:29:49.228861 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-5eec3960-b77a-4966-b8ba-f565557ba50e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 23:29:49.234143 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563c1473e9c0 pid: 103462 (default app) Jul 21 23:31:06.315266 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:06.316273 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 21 23:31:06.316933 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:06.329860 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_api:SELECT=3 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:06.330995 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_cell0:SELECT=3 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:06.331761 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_cell1:SELECT=3 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:06.332801 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:07.207659 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-1931d65e-e43a-44d5-b7ff-fa0b89f0fa78 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:07.242313 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-1931d65e-e43a-44d5-b7ff-fa0b89f0fa78 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917632 Jul 21 23:31:07.243377 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jul 21 23:31:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:31:09.495612 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:09.496616 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-415b1647-c7ed-4eef-901b-59979ea0f223 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 21 23:31:09.497012 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:09.957030 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-63b81e57-39e5-46d8-9a41-b6e22f9e3593 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "ram": 256}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:09.976082 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:31:09.976082 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: warnings.warn(msg) Jul 21 23:31:10.006195 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-63b81e57-39e5-46d8-9a41-b6e22f9e3593 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.503085 Jul 21 23:31:10.007016 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 23:31:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:31:10.020274 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_api:SELECT=3 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:10.021607 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_cell0:SELECT=3 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:10.022345 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_cell1:SELECT=3 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:10.023227 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:10.233169 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-a1bf0f0e-4442-46b9-ba92-aa879c3c0f43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:10.235621 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:31:10.235621 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Jul 21 23:31:10.304883 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-a1bf0f0e-4442-46b9-ba92-aa879c3c0f43 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289858 Jul 21 23:31:10.317417 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jul 21 23:31:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:31:12.580520 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-63b81e57-39e5-46d8-9a41-b6e22f9e3593 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:12.581577 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-63b81e57-39e5-46d8-9a41-b6e22f9e3593 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 21 23:31:12.582146 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:13.267159 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-8f1560a5-3996-4dd2-9277-1f9be0522295 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "ram": 512, "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:13.286143 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:31:13.286143 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Jul 21 23:31:13.310281 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-8f1560a5-3996-4dd2-9277-1f9be0522295 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.721751 Jul 21 23:31:13.311063 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 23:31:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 23:31:13.323557 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-f430bf90-16e7-4c66-a436-f8fa1b0763af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:13.325047 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:31:13.325047 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: warnings.warn(msg) Jul 21 23:31:13.359021 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-f430bf90-16e7-4c66-a436-f8fa1b0763af admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039162 Jul 21 23:31:13.365462 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jul 21 23:31:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:31:15.603397 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-8f1560a5-3996-4dd2-9277-1f9be0522295 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:15.604782 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-8f1560a5-3996-4dd2-9277-1f9be0522295 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 21 23:31:15.613820 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:15 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:16.013755 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-18d2ba24-7768-46a9-a48b-ef7a792cf4af admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:16.032212 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-18d2ba24-7768-46a9-a48b-ef7a792cf4af admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.421540 Jul 21 23:31:16.032695 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 23:31:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:31:16.045295 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-023e1f0f-b3ee-4296-9918-e83044db9f83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:16.069636 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-023e1f0f-b3ee-4296-9918-e83044db9f83 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028012 Jul 21 23:31:16.070679 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jul 21 23:31:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:31:18.306818 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-18d2ba24-7768-46a9-a48b-ef7a792cf4af admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:18.308015 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-18d2ba24-7768-46a9-a48b-ef7a792cf4af admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Jul 21 23:31:18.309044 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:18.737772 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-8c64cdbf-3b53-4d47-b6e1-4167d3c1374e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "ram": 2048, "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:18.766384 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-8c64cdbf-3b53-4d47-b6e1-4167d3c1374e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450808 Jul 21 23:31:18.767658 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 23:31:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:31:18.781573 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-cdd2f655-5522-4c56-813b-62be0a3cd9cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:18.809430 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-cdd2f655-5522-4c56-813b-62be0a3cd9cd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031230 Jul 21 23:31:18.810547 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jul 21 23:31:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:31:21.078832 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-8c64cdbf-3b53-4d47-b6e1-4167d3c1374e admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:21.079944 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-8c64cdbf-3b53-4d47-b6e1-4167d3c1374e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Jul 21 23:31:21.080450 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:21.499453 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-57892c2c-8b0a-468a-8685-bbd7285582f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "ram": 4096}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:21.517619 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-57892c2c-8b0a-468a-8685-bbd7285582f5 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431161 Jul 21 23:31:21.518322 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 23:31:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:31:21.531158 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-1127f67c-1191-4743-a053-44116d5a7936 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:21.555059 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-1127f67c-1191-4743-a053-44116d5a7936 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027585 Jul 21 23:31:21.555642 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jul 21 23:31:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:31:23.859657 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-57892c2c-8b0a-468a-8685-bbd7285582f5 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:23.861074 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-57892c2c-8b0a-468a-8685-bbd7285582f5 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001742 Jul 21 23:31:23.861614 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:24.320359 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-2156f1d9-e6da-4796-8fdf-77986d347e85 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:24.345233 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-2156f1d9-e6da-4796-8fdf-77986d347e85 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.476840 Jul 21 23:31:24.345803 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jul 21 23:31:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:31:27.188078 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-57892c2c-8b0a-468a-8685-bbd7285582f5 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:27.189104 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-57892c2c-8b0a-468a-8685-bbd7285582f5 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 21 23:31:27.189549 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:27.650135 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-0152afdb-5680-4265-8fb7-d37d713ef79d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:27.672889 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-0152afdb-5680-4265-8fb7-d37d713ef79d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.476696 Jul 21 23:31:27.673663 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 23:31:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 23:31:27.688417 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-993a1f5e-9017-46c8-bc93-2b13f06cd3c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:27.714321 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-993a1f5e-9017-46c8-bc93-2b13f06cd3c4 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030315 Jul 21 23:31:27.715049 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jul 21 23:31:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:31:30.005091 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-0152afdb-5680-4265-8fb7-d37d713ef79d admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:30.006810 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-0152afdb-5680-4265-8fb7-d37d713ef79d admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Jul 21 23:31:30.007215 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:30.405402 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-1e878fec-7124-40c6-b458-03acd5ba4e69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "name": "m1.small", "disk": 20}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:30.423464 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-1e878fec-7124-40c6-b458-03acd5ba4e69 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.409691 Jul 21 23:31:30.424011 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 23:31:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:31:30.436373 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-9f65c5ea-9a94-4884-a4ae-e961247b21dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:30.459451 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-9f65c5ea-9a94-4884-a4ae-e961247b21dc admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026869 Jul 21 23:31:30.460019 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jul 21 23:31:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:31:32.731035 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-1e878fec-7124-40c6-b458-03acd5ba4e69 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:32.732203 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-1e878fec-7124-40c6-b458-03acd5ba4e69 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jul 21 23:31:32.732649 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:33.153819 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-c91d9766-0d1c-4fb0-82f8-62165c3e70f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:33.175821 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-c91d9766-0d1c-4fb0-82f8-62165c3e70f5 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.436772 Jul 21 23:31:33.184227 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 23:31:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:31:33.189285 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-00739f65-e826-4976-a4f4-e2a11bc241a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:33.213352 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-00739f65-e826-4976-a4f4-e2a11bc241a3 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027754 Jul 21 23:31:33.232996 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jul 21 23:31:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:31:35.488372 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-c91d9766-0d1c-4fb0-82f8-62165c3e70f5 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:35.492794 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-c91d9766-0d1c-4fb0-82f8-62165c3e70f5 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 21 23:31:35.495450 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:35 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:35.928020 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-543c8508-3b77-4760-b677-90e94ff2bfe2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:35.948248 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-543c8508-3b77-4760-b677-90e94ff2bfe2 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451519 Jul 21 23:31:35.948809 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 23:31:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 23:31:35.961599 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-e6793e64-f562-498d-a924-cd3809224490 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:35.989240 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-e6793e64-f562-498d-a924-cd3809224490 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032047 Jul 21 23:31:36.001215 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jul 21 23:31:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:31:38.324689 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-543c8508-3b77-4760-b677-90e94ff2bfe2 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:38.325902 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-543c8508-3b77-4760-b677-90e94ff2bfe2 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Jul 21 23:31:38.326381 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:38.778588 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-6849553d-7f40-451d-b34a-0cae944707d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "vcpus": 8, "id": "5", "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:38.799910 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-6849553d-7f40-451d-b34a-0cae944707d3 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.467526 Jul 21 23:31:38.800462 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 23:31:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:31:38.813910 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-76532d5e-d5fb-4b25-a967-a071469f8a52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:31:38.817890 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:38.844677 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-76532d5e-d5fb-4b25-a967-a071469f8a52 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036073 Jul 21 23:31:38.853716 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jul 21 23:31:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:31:58.153609 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-6849553d-7f40-451d-b34a-0cae944707d3 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:58.154716 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-6849553d-7f40-451d-b34a-0cae944707d3 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Jul 21 23:31:58.155112 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:31:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:31:58.166216 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:58.543471 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-7cc747fe-1dc7-41fb-8cc7-96e2803057f0 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:58.560040 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-7cc747fe-1dc7-41fb-8cc7-96e2803057f0 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399070 Jul 21 23:31:58.560569 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jul 21 23:31:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:31:59.633138 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-6849553d-7f40-451d-b34a-0cae944707d3 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:31:59.634168 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-6849553d-7f40-451d-b34a-0cae944707d3 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 21 23:31:59.634557 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:31:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:32:00.155306 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-99c86cdc-b1c1-4fbe-8be5-2f09734c2f46 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:00.160860 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.wsgi [None req-99c86cdc-b1c1-4fbe-8be5-2f09734c2f46 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-99c86cdc-b1c1-4fbe-8be5-2f09734c2f46 admin admin] Request method failure captured: Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Accept: application/json Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Accept-Encoding: gzip, deflate Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Connection: keep-alive Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Content-Length: 0 Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Host: 10.222.0.57 Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Openstack-Api-Version: compute 2.90 Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Openstack-System-Scope: None Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: User-Agent: python-novaclient Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Auth-Token: gAAAAABi2eHv3kygoHT8d5xySRVd6Rbr-hbJoI8V2Z22SvN9Wx-YuhaVdyKdTnQIX6Z6tBXNFUyAhUC1HDaLFrsy8VwHGQKXdQ9ml2fpwib05O9tD9GHzE3909TNfOcNw_cWQEjxWkROgQSr1d2BYOv5BUrDzMCxHARqTn6sXL5inbB9Hhr3yfA Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Domain-Id: None Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Domain-Name: None Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Identity-Status: Confirmed Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Is-Admin-Project: True Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Id: default Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Name: Default Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Name: admin Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Role: reader,admin,member Jul 21 23:32:00.164678 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Roles: reader,admin,member Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_853ebd43a36d473dbecd2e6330bf3136", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}] Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Tenant: admin Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Tenant-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Tenant-Name: admin Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User: admin Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Id: default Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Name: Default Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Id: 055fbabca2a64bd6aab2d3bd73469ee6 Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Name: admin Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: method: > Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: exception: Flavor 42 could not be found. Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: action_args: {'id': '42'} Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:32:00.166222 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:00.167042 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:00.168102 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-99c86cdc-b1c1-4fbe-8be5-2f09734c2f46 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:32:00.169270 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-99c86cdc-b1c1-4fbe-8be5-2f09734c2f46 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.396874 Jul 21 23:32:00.169270 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jul 21 23:31:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:00.175665 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-1d9a652d-33ff-40f7-94c2-4cd5e4189640 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:00.179281 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:00.198928 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-1d9a652d-33ff-40f7-94c2-4cd5e4189640 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026785 Jul 21 23:32:00.199465 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 23:32:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:32:00.209151 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-357c91f1-f313-43d8-bfba-37057ade656b admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:00.230551 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-357c91f1-f313-43d8-bfba-37057ade656b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025044 Jul 21 23:32:00.231076 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 23:32:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:32:00.241030 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-814af7bd-a8bc-4556-981a-2252cc3fadbf admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:00.246690 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.wsgi [None req-814af7bd-a8bc-4556-981a-2252cc3fadbf admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-814af7bd-a8bc-4556-981a-2252cc3fadbf admin admin] Request method failure captured: Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Accept: application/json Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Accept-Encoding: gzip, deflate Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Connection: keep-alive Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Content-Length: 0 Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Host: 10.222.0.57 Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Openstack-Api-Version: compute 2.90 Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Openstack-System-Scope: None Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: User-Agent: python-novaclient Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Auth-Token: gAAAAABi2eHv3kygoHT8d5xySRVd6Rbr-hbJoI8V2Z22SvN9Wx-YuhaVdyKdTnQIX6Z6tBXNFUyAhUC1HDaLFrsy8VwHGQKXdQ9ml2fpwib05O9tD9GHzE3909TNfOcNw_cWQEjxWkROgQSr1d2BYOv5BUrDzMCxHARqTn6sXL5inbB9Hhr3yfA Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Domain-Id: None Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Domain-Name: None Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Identity-Status: Confirmed Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Is-Admin-Project: True Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Id: default Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Name: Default Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Name: admin Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Role: reader,admin,member Jul 21 23:32:00.249911 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Roles: reader,admin,member Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_853ebd43a36d473dbecd2e6330bf3136", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}] Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Tenant: admin Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Tenant-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Tenant-Name: admin Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User: admin Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Id: default Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Name: Default Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Id: 055fbabca2a64bd6aab2d3bd73469ee6 Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Name: admin Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: method: > Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: exception: Flavor 42 could not be found. Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: action_args: {'id': '42'} Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:32:00.251421 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:00.252409 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:00.253995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-814af7bd-a8bc-4556-981a-2252cc3fadbf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:32:00.255219 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-814af7bd-a8bc-4556-981a-2252cc3fadbf admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014734 Jul 21 23:32:00.255219 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jul 21 23:32:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:01.216848 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-357c91f1-f313-43d8-bfba-37057ade656b admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:01.217897 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-357c91f1-f313-43d8-bfba-37057ade656b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 21 23:32:01.218291 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:32:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:32:01.734183 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-46c9307f-2070-414b-b3b9-3c4bb3726479 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:01.739441 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.wsgi [None req-46c9307f-2070-414b-b3b9-3c4bb3726479 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-46c9307f-2070-414b-b3b9-3c4bb3726479 admin admin] Request method failure captured: Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Accept: application/json Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Accept-Encoding: gzip, deflate Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Connection: keep-alive Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Content-Length: 0 Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Host: 10.222.0.57 Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Openstack-Api-Version: compute 2.90 Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Openstack-System-Scope: None Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: User-Agent: python-novaclient Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Auth-Token: gAAAAABi2eHxIv5AzDwOg6H8g8FumoVkn4umSZsynNppm43OSmLrXWpwTWJUftBvIRmJsGckuDsrzmuEa0B1p_hmdZF7rQLHmtHPDFt_nT0tBEPIkrAcuqhIXqLrfWxiMlzonSNsCeDhoZ1hsQDpMWvWcCwJM6N-tP_SU6ANe2lH54ascLEwUqQ Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Domain-Id: None Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Domain-Name: None Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Identity-Status: Confirmed Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Is-Admin-Project: True Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Id: default Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Name: Default Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Name: admin Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Role: reader,admin,member Jul 21 23:32:01.741699 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Roles: reader,admin,member Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_853ebd43a36d473dbecd2e6330bf3136", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}] Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Tenant: admin Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Tenant-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Tenant-Name: admin Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User: admin Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Id: default Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Name: Default Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Id: 055fbabca2a64bd6aab2d3bd73469ee6 Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Name: admin Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: method: > Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: exception: Flavor 84 could not be found. Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: action_args: {'id': '84'} Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:32:01.743211 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:01.744190 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:01.745536 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-46c9307f-2070-414b-b3b9-3c4bb3726479 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:32:01.746742 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-46c9307f-2070-414b-b3b9-3c4bb3726479 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.387539 Jul 21 23:32:01.746742 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jul 21 23:32:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:01.752493 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-600b2efa-ea02-4a8a-a186-f066917a5470 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:01.766749 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-600b2efa-ea02-4a8a-a186-f066917a5470 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017708 Jul 21 23:32:01.767210 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 23:32:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:32:01.776413 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-adbe10c0-b438-4cf9-bb7a-a912a86128c1 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:01.790244 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-adbe10c0-b438-4cf9-bb7a-a912a86128c1 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017235 Jul 21 23:32:01.790746 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 23:32:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:32:01.799584 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-005e1fb0-bc10-4a1b-a78b-8e0dd882d213 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:01.805611 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.wsgi [None req-005e1fb0-bc10-4a1b-a78b-8e0dd882d213 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-005e1fb0-bc10-4a1b-a78b-8e0dd882d213 admin admin] Request method failure captured: Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Accept: application/json Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Accept-Encoding: gzip, deflate Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Connection: keep-alive Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Content-Length: 0 Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Host: 10.222.0.57 Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Openstack-Api-Version: compute 2.90 Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Openstack-System-Scope: None Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: User-Agent: python-novaclient Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Auth-Token: gAAAAABi2eHxIv5AzDwOg6H8g8FumoVkn4umSZsynNppm43OSmLrXWpwTWJUftBvIRmJsGckuDsrzmuEa0B1p_hmdZF7rQLHmtHPDFt_nT0tBEPIkrAcuqhIXqLrfWxiMlzonSNsCeDhoZ1hsQDpMWvWcCwJM6N-tP_SU6ANe2lH54ascLEwUqQ Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Domain-Id: None Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Domain-Name: None Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Identity-Status: Confirmed Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Is-Admin-Project: True Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Id: default Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Name: Default Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Name: admin Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Role: reader,admin,member Jul 21 23:32:01.807100 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Roles: reader,admin,member Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_853ebd43a36d473dbecd2e6330bf3136", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}] Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Tenant: admin Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Tenant-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Tenant-Name: admin Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User: admin Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Id: default Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Name: Default Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Id: 055fbabca2a64bd6aab2d3bd73469ee6 Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Name: admin Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: method: > Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: exception: Flavor 84 could not be found. Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: action_args: {'id': '84'} Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:32:01.808642 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:01.809523 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:01.810851 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-005e1fb0-bc10-4a1b-a78b-8e0dd882d213 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:32:01.812058 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-005e1fb0-bc10-4a1b-a78b-8e0dd882d213 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012338 Jul 21 23:32:01.812058 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jul 21 23:32:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:02.779577 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-adbe10c0-b438-4cf9-bb7a-a912a86128c1 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:02.780633 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-adbe10c0-b438-4cf9-bb7a-a912a86128c1 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 21 23:32:02.781025 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:32:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:32:03.306489 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-a737f151-0b69-40be-94be-64deb660d160 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:03.312186 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.wsgi [None req-a737f151-0b69-40be-94be-64deb660d160 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-a737f151-0b69-40be-94be-64deb660d160 admin admin] Request method failure captured: Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Accept: application/json Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Accept-Encoding: gzip, deflate Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Connection: keep-alive Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Content-Length: 0 Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Host: 10.222.0.57 Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Openstack-Api-Version: compute 2.90 Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Openstack-System-Scope: None Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: User-Agent: python-novaclient Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Auth-Token: gAAAAABi2eHyG_wM9Z7NINNUnD7RTAxA5_VqQxwpJgk9bpTcqM8xeG_qPlShi3ipXIY_DkteifjN8fvc7g-ulUj3kvHlRZmvVGwoWB89pkgCxe6lYiSvPt0TX5L8S1uH-4A6E_AahE31qYN5BiNCcj00B5e0ciFTe6JIeYJ3diWoXBevjYCdokI Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Domain-Id: None Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Domain-Name: None Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Identity-Status: Confirmed Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Is-Admin-Project: True Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Id: default Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Domain-Name: Default Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Project-Name: admin Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Role: reader,admin,member Jul 21 23:32:03.313773 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Roles: reader,admin,member Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_853ebd43a36d473dbecd2e6330bf3136", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}] Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Tenant: admin Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Tenant-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-Tenant-Name: admin Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User: admin Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Id: default Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Domain-Name: Default Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Id: 055fbabca2a64bd6aab2d3bd73469ee6 Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: X-User-Name: admin Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: method: > Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: exception: Flavor 451 could not be found. Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: action_args: {'id': '451'} Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:32:03.315347 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:03.316235 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Jul 21 23:32:03.317426 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-a737f151-0b69-40be-94be-64deb660d160 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:32:03.319276 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-a737f151-0b69-40be-94be-64deb660d160 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394992 Jul 21 23:32:03.319276 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 23:32:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:03.325267 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-e128fc4c-cb2a-4794-8e92-1ad59e6d89e8 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:03.340077 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-e128fc4c-cb2a-4794-8e92-1ad59e6d89e8 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018367 Jul 21 23:32:03.340593 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 23:32:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:32:03.349887 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:03.364309 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017950 Jul 21 23:32:03.365519 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 23:32:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:32:03.374813 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-9e35598b-d563-47d9-ab6d-0c6f75e3c031 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:03.380500 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.wsgi [None req-9e35598b-d563-47d9-ab6d-0c6f75e3c031 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-9e35598b-d563-47d9-ab6d-0c6f75e3c031 admin admin] Request method failure captured: Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Accept: application/json Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Accept-Encoding: gzip, deflate Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Connection: keep-alive Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Content-Length: 0 Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Host: 10.222.0.57 Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Openstack-Api-Version: compute 2.90 Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Openstack-System-Scope: None Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: User-Agent: python-novaclient Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Auth-Token: gAAAAABi2eHyG_wM9Z7NINNUnD7RTAxA5_VqQxwpJgk9bpTcqM8xeG_qPlShi3ipXIY_DkteifjN8fvc7g-ulUj3kvHlRZmvVGwoWB89pkgCxe6lYiSvPt0TX5L8S1uH-4A6E_AahE31qYN5BiNCcj00B5e0ciFTe6JIeYJ3diWoXBevjYCdokI Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Domain-Id: None Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Domain-Name: None Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Identity-Status: Confirmed Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Is-Admin-Project: True Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Id: default Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Domain-Name: Default Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Project-Name: admin Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Role: reader,admin,member Jul 21 23:32:03.382181 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Roles: reader,admin,member Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/853ebd43a36d473dbecd2e6330bf3136"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_853ebd43a36d473dbecd2e6330bf3136", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/853ebd43a36d473dbecd2e6330bf3136"}]}] Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Tenant: admin Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Tenant-Id: 853ebd43a36d473dbecd2e6330bf3136 Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-Tenant-Name: admin Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User: admin Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Id: default Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Domain-Name: Default Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Id: 055fbabca2a64bd6aab2d3bd73469ee6 Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: X-User-Name: admin Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: method: > Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: exception: Flavor 451 could not be found. Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: action_args: {'id': '451'} Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:32:03.383780 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:03.386243 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: ERROR nova.api.openstack.wsgi Jul 21 23:32:03.387501 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-9e35598b-d563-47d9-ab6d-0c6f75e3c031 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:32:03.388718 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-9e35598b-d563-47d9-ab6d-0c6f75e3c031 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012265 Jul 21 23:32:03.388718 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 23:32:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:04.356128 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:04.357170 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 21 23:32:04.357592 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:32:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:32:04.877656 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-79ab7b68-f697-47b6-b74d-e16cb128d635 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:32:04.896396 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-79ab7b68-f697-47b6-b74d-e16cb128d635 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401701 Jul 21 23:32:04.896933 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jul 21 23:32:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:32:05.867137 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:05.868146 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 21 23:32:05.868543 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:32:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:32:06.388770 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-6be77f16-19a8-4cf4-ba86-e8b727ff8168 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:32:06.406023 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-6be77f16-19a8-4cf4-ba86-e8b727ff8168 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.399191 Jul 21 23:32:06.406564 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jul 21 23:32:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 23:32:07.379613 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:07.381180 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002247 Jul 21 23:32:07.381618 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:32:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:32:07.904966 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-53525065-3438-4bd2-9962-fda07508deb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:32:07.922134 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-53525065-3438-4bd2-9962-fda07508deb8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.402997 Jul 21 23:32:07.922660 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jul 21 23:32:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:32:08.906038 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:08.907044 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 21 23:32:08.907477 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:32:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:32:09.430185 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-f1cacc84-d1c5-441f-b013-722ac2ad7b27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:32:09.448433 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-f1cacc84-d1c5-441f-b013-722ac2ad7b27 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.404104 Jul 21 23:32:09.448972 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jul 21 23:32:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:32:10.421604 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:10.422610 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 21 23:32:10.423006 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:32:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:32:10.944597 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-4254b9eb-84ac-48ca-a4dd-ff15a9794014 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:32:10.963869 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-4254b9eb-84ac-48ca-a4dd-ff15a9794014 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405191 Jul 21 23:32:10.964015 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Thu Jul 21 23:32:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:33:03.144085 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:33:03.145075 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-553973d6-d496-4c29-8e41-19208e9e5e9e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 21 23:33:03.145518 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 23:33:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:33:03.155812 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:03.537231 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-712e4ae6-e95c-415f-9093-d6e00f544828 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:33:03.555981 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-712e4ae6-e95c-415f-9093-d6e00f544828 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404583 Jul 21 23:33:03.556570 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jul 21 23:33:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:33:03.576873 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_api:SELECT=14 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:03.580654 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-e7a63c24-b213-45bb-b54b-0cc6f3435969 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:33:03.588998 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-e7a63c24-b213-45bb-b54b-0cc6f3435969 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013523 Jul 21 23:33:03.589568 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Thu Jul 21 23:33:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:33:03.601504 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-f6796761-e751-4ff9-bd66-2248fca7faef admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:33:03.609320 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-f6796761-e751-4ff9-bd66-2248fca7faef admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011911 Jul 21 23:33:03.609857 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Thu Jul 21 23:33:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:33:03.621586 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-cfe2c368-ec59-4d3f-a642-0bc777277fec admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:33:03.629379 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-cfe2c368-ec59-4d3f-a642-0bc777277fec admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010982 Jul 21 23:33:03.629940 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Thu Jul 21 23:33:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:33:03.641018 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-58dda5de-fd55-4bbd-b16f-ff36eecd1322 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:33:03.649544 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-58dda5de-fd55-4bbd-b16f-ff36eecd1322 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011835 Jul 21 23:33:03.650048 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Thu Jul 21 23:33:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:36:29.382580 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-cfe2c368-ec59-4d3f-a642-0bc777277fec admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:36:29.383716 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-cfe2c368-ec59-4d3f-a642-0bc777277fec admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Jul 21 23:36:29.384127 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:36:29.525706 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_api:SELECT=6 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:36:29.686872 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-163112fe-08a6-49aa-8647-b32a74047f78 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:36:29.688033 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:36:29.688033 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Jul 21 23:36:29.689822 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-163112fe-08a6-49aa-8647-b32a74047f78 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:36:29.690278 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-163112fe-08a6-49aa-8647-b32a74047f78 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:36:29.691053 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-163112fe-08a6-49aa-8647-b32a74047f78 admin admin] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:36:29.691479 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-163112fe-08a6-49aa-8647-b32a74047f78 admin admin] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:36:29.724621 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-163112fe-08a6-49aa-8647-b32a74047f78 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200440 Jul 21 23:36:29.725171 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 23:36:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:36:30.571658 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-cfe2c368-ec59-4d3f-a642-0bc777277fec admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:36:30.572735 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-cfe2c368-ec59-4d3f-a642-0bc777277fec admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 21 23:36:30.573162 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:36:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:36:30.768826 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-27f69630-cdd4-43a6-bfe2-fa77f7782bae admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:36:30.770079 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:36:30.770079 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Jul 21 23:36:30.771250 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-27f69630-cdd4-43a6-bfe2-fa77f7782bae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:36:30.771687 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-27f69630-cdd4-43a6-bfe2-fa77f7782bae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:36:30.772460 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-27f69630-cdd4-43a6-bfe2-fa77f7782bae admin admin] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:36:30.772882 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-27f69630-cdd4-43a6-bfe2-fa77f7782bae admin admin] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:36:30.792004 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-27f69630-cdd4-43a6-bfe2-fa77f7782bae admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075159 Jul 21 23:36:30.792524 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 23:36:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 23:36:42.028198 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-cfe2c368-ec59-4d3f-a642-0bc777277fec admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:36:42.029241 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-cfe2c368-ec59-4d3f-a642-0bc777277fec admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 21 23:36:42.029649 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:36:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:36:42.171126 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_cell0:SELECT=4 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:36:42.171844 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_cell1:SELECT=4 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:36:42.172453 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG dbcounter [-] [103461] Writing DB stats nova_api:SELECT=8 {{(pid=103461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:36:42.220771 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-d865540d-92fb-4a0f-80de-173787600837 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:36:42.221995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:36:42.221995 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Jul 21 23:36:42.223177 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-d865540d-92fb-4a0f-80de-173787600837 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:36:42.223629 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-d865540d-92fb-4a0f-80de-173787600837 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:36:42.224423 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-d865540d-92fb-4a0f-80de-173787600837 admin admin] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:36:42.224853 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-d865540d-92fb-4a0f-80de-173787600837 admin admin] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:36:42.250653 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-d865540d-92fb-4a0f-80de-173787600837 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083935 Jul 21 23:36:42.251213 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 23:36:42 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:36:43.216376 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-cfe2c368-ec59-4d3f-a642-0bc777277fec admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:36:43.217489 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-cfe2c368-ec59-4d3f-a642-0bc777277fec admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 21 23:36:43.217889 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 23:36:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:36:43.410884 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG nova.api.openstack.wsgi [None req-d5533cdd-4f7b-44a7-aff7-8d818d473982 admin admin] Calling method '>' {{(pid=103461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:36:43.412085 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:36:43.412085 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: warnings.warn(msg) Jul 21 23:36:43.413317 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-d5533cdd-4f7b-44a7-aff7-8d818d473982 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:36:43.413766 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-d5533cdd-4f7b-44a7-aff7-8d818d473982 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:36:43.414542 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-d5533cdd-4f7b-44a7-aff7-8d818d473982 admin admin] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:36:43.415007 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: DEBUG oslo_concurrency.lockutils [None req-d5533cdd-4f7b-44a7-aff7-8d818d473982 admin admin] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:36:43.437723 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: INFO nova.api.openstack.requestlog [None req-d5533cdd-4f7b-44a7-aff7-8d818d473982 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080279 Jul 21 23:36:43.438270 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: [pid: 103461|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 23:36:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:37:38.343066 dv-cinder-850700-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 23:37:38.344132 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: Thu Jul 21 23:37:38 2022 - graceful shutdown triggered... Jul 21 23:37:38.344576 dv-cinder-850700-1-iscsi devstack@n-api.service[103462]: Gracefully killing worker 2 (pid: 103462)... Jul 21 23:37:38.344944 dv-cinder-850700-1-iscsi devstack@n-api.service[103461]: Gracefully killing worker 1 (pid: 103461)... Jul 21 23:37:39.345067 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: worker 1 buried after 1 seconds Jul 21 23:37:39.345067 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: worker 2 buried after 1 seconds Jul 21 23:37:39.345067 dv-cinder-850700-1-iscsi devstack@n-api.service[103460]: goodbye to uWSGI. Jul 21 23:37:39.346689 dv-cinder-850700-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 23:37:39.347244 dv-cinder-850700-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 23:37:39.350055 dv-cinder-850700-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 23:37:39.359766 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 23:37:39 2022] *** Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: nodename: dv-cinder-850700-1-iscsi Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: machine: x86_64 Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: clock source: unix Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: pcre jit disabled Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: detected number of CPU cores: 4 Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: current working directory: / Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: detected binary path: /usr/bin/uwsgi-core Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: your processes number limit is 47680 Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: your memory page size is 4096 bytes Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: detected max file descriptor number: 2048 Jul 21 23:37:39.362626 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: lock engine: pthread robust mutexes Jul 21 23:37:39.363495 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: thunder lock: enabled Jul 21 23:37:39.363495 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 23:37:39.363495 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 23:37:39.406733 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: Python main interpreter initialized at 0x55b9e8e4e9c0 Jul 21 23:37:39.406733 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: python threads support enabled Jul 21 23:37:39.406733 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: your server socket listen backlog is limited to 100 connections Jul 21 23:37:39.406733 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: your mercy for graceful operations on workers is 90 seconds Jul 21 23:37:39.407139 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 23:37:39.407139 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: *** Operational MODE: preforking *** Jul 21 23:37:39.407415 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: *** uWSGI is running in multiple interpreter mode *** Jul 21 23:37:39.407415 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: spawned uWSGI master process (pid: 124375) Jul 21 23:37:39.407616 dv-cinder-850700-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 23:37:39.408715 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: spawned uWSGI worker 1 (pid: 124387, cores: 1) Jul 21 23:37:39.408715 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: spawned uWSGI worker 2 (pid: 124388, cores: 1) Jul 21 23:37:39.408715 dv-cinder-850700-1-iscsi devstack@n-api.service[124375]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 23:37:40.083214 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 23:37:40.088047 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 23:37:41.287873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:37:41.287873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: from cryptography.utils import int_from_bytes Jul 21 23:37:41.288510 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:37:41.288510 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: from cryptography.utils import int_from_bytes Jul 21 23:37:41.304351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:37:41.304351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: from cryptography.utils import int_from_bytes Jul 21 23:37:41.305018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:37:41.305018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: from cryptography.utils import int_from_bytes Jul 21 23:37:43.636357 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 23:37:43.636912 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 23:37:43.637206 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 23:37:43.637443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 23:37:43.637700 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 23:37:43.638084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.638405 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.638720 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.639033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.639357 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.639659 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.640069 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.640862 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.641207 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.641483 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.641793 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.642117 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850700-1-iscsi {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.642431 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.642736 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.643039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.643352 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.643651 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.643965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.644263 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.644761 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.646139 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.646139 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.646139 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.646503 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.646623 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 23:37:43.647019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.647108 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 23:37:43.647188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.647398 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 23:37:43.647637 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.647637 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.648050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 23:37:43.648050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 23:37:43.648464 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.648464 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.648878 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.648878 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.649390 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850700-1-iscsi {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.649603 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.649843 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.650062 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.650282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.650282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.650703 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.650703 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.651114 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.651336 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.651553 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.651774 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.651992 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.652216 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.652422 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.652621 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.652853 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.653037 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.653201 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.653373 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850700-1-iscsi {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.653556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.653699 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.653853 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.653998 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.654172 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.654337 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.654489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.654665 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.654839 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.654985 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.655162 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.655321 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.655512 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.655736 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.655983 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.655983 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.656320 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.656490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.656650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.657295 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.657462 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.657620 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.657853 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.658001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.658283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.658443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.658879 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.659039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.659203 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.659355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.659355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.659655 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.659655 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.659938 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.660095 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.660247 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.660404 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.660549 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.660549 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.660841 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850700-1-iscsi {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.660987 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.661137 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.661349 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.661524 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.661677 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.661836 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.661988 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.662139 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.662286 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.662441 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.662595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.662745 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.662896 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.663046 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.663197 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.663361 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.663513 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.663656 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.663807 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.663962 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.664106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.664262 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.664414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.664414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.664756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.664909 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.665062 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.665062 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.665410 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.665556 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.665713 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.665864 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.666018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.666163 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.666317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.666462 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.666616 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.666761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.666951 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.667496 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.667659 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.667815 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.667967 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.668110 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.668263 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.668414 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.668559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.668726 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.669118 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.669371 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.669531 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.669685 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.669850 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.669995 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.670138 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.670297 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.670445 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.670595 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.670747 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.670890 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.671042 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.671195 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.671346 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.671496 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.671651 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.671884 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.672090 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.672283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.672439 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.672582 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.672737 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.672882 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.673073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.673073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.673401 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.673553 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.673696 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.673846 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.674016 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.674161 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.674304 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.674446 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.674601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.674756 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.674915 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.675067 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.675212 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.675355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.675506 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.675663 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.675813 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.675976 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.676128 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.676128 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.676410 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.676600 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.676749 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.676892 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.677055 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.677670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.677828 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.677982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.678136 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.678299 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.678453 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.678598 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.678741 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.678741 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.679516 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.679680 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.679839 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.679839 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.680126 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.680269 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.680570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.680730 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.680895 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.681040 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.681225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.681378 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.681522 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.681678 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.681823 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.681973 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.682124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.682297 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.682474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.682640 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.682791 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.682950 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.683099 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.683245 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.683394 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.683551 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.683703 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.683854 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.683998 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.683998 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.684287 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.684441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.684585 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.684585 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.684885 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.685037 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.685229 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.685229 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.685522 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.685666 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.685816 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.685971 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.686125 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.686125 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.686461 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.686608 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.686762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.687890 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.688113 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.688288 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.688435 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.688666 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.688823 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.688976 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.689121 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.689304 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.689718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.689882 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.690034 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.690198 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.690344 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.690494 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.690648 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.690800 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.690945 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.691088 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.691241 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.691393 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.691552 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.691712 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.691864 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.692008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.692168 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.692313 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.692466 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.692622 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.692774 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.692926 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.693077 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.693297 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.693459 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.693611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.693764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.693909 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.694071 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.694224 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.694369 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.694513 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.694658 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.694810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.694961 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.695118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.695273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.695418 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.695562 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.695712 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.695867 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.696034 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.696185 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.696330 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.696473 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.696624 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.696782 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.696782 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.697090 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:37:43.697261 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.697418 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.697976 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.698141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.698296 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.698462 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.698608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.698751 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.698900 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.699053 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.699209 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.699362 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.699532 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.699936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.700095 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.700250 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.700414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.700579 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.700724 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.700876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.701027 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.701197 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.701368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.701520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.701664 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.701807 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.701957 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.702110 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.702264 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.702478 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.703892 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.704061 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.704217 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.704377 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.704537 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.704683 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.704827 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.704971 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.705115 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.705315 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.705463 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.705609 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.705760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.705917 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.706068 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.706226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.706380 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.706536 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.706681 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.706833 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.706985 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.707140 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.707286 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.707439 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.707584 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.708133 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.708326 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.708482 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.708627 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.708780 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.708933 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.709085 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.709261 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.709421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.709568 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.709568 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.710137 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.710300 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.710474 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.710754 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.710926 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.711081 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.711226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.711378 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.711532 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.711686 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.711839 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.711984 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.712129 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.712282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.712434 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.712605 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.712750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.712901 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.713053 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.713227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.713378 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.713533 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.713533 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.715982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.716133 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.716133 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.716434 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.716581 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.716902 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.717047 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.717267 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.717429 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.717575 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.717726 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.717891 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.718488 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.718652 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.718800 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.718953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.719108 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.719273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.719428 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.719573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.719725 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.719876 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.720313 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.720459 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.720690 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.720846 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.720992 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.721135 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.721303 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.721461 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.721622 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.721775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.721775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.722051 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.722193 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.722351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.722496 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.722639 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.722782 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.722926 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.723078 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.723232 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.723393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.723545 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.723690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.723834 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.723978 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.724139 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.724284 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.724429 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.724578 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.724722 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.724873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.725026 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.725180 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.725358 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.725513 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.725658 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.725810 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.725954 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.726097 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.726241 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.726395 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.726395 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.726395 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.726876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.727027 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.727027 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.727328 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.727473 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.727624 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.727777 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.727935 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.728084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.728650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.728813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.728813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.728813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.728813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.728813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.728813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.728813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.728813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.730026 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.730026 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.730026 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.730026 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.730026 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.731007 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.731160 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.731310 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.731468 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.731468 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.731781 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.731941 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.732092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.732250 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.732400 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.732558 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.732717 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.732869 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.733018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.733167 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.733351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.733503 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.733701 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.733943 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.734102 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.734293 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.734481 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.734645 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.734805 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.734956 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.735106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.735262 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.735419 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.735584 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.735737 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.735926 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.736094 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.736288 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.736288 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.736288 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.736735 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.736893 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.737044 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.737435 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.737617 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.737788 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.737788 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.738095 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.738246 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.738796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.738972 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.739124 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.739273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.739423 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.739572 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.739721 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.739885 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.740043 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.740194 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.740613 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.740818 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.740983 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.741144 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.741373 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.741526 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.741684 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.741834 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.741984 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.742143 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.742143 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.742437 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.742594 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.742751 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.742916 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.743095 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.743247 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.743403 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.743553 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.743709 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.743868 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.744018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.744168 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.744316 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.744472 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.744629 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.744788 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.744946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.745116 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.745327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.745479 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.745628 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.745789 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.745946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.746096 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.746254 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.746411 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.746561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.746724 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.746724 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.747026 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.747188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.747355 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.747591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.747757 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.747918 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.748076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.748227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.748383 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.748562 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.749052 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.749225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.749920 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.750156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.750847 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.751016 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.751177 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.751328 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.751479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.751629 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.751778 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.751936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.752087 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.752243 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.752395 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.752551 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.752795 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.752950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.753107 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.753281 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.753435 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.753595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.753761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.753761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.754061 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.754213 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.754370 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.754370 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.754673 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.754843 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.754994 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.755144 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.755294 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.756053 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.756219 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.756372 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.756535 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.756535 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.756832 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.756982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.757143 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.757355 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.757523 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.757784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.757950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.758116 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.758267 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.758267 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.758576 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.759179 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.759403 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.759568 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.759727 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.759892 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.760050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.760201 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.760352 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.760516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.760687 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.761035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.761242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.761489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.761658 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.761825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.761987 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.762138 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.762323 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.762489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.762489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.762788 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.762940 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.763090 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.763246 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.763398 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.763563 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.763723 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.763881 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.764040 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.764191 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.764352 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.764516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.764676 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.764833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.765128 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.765335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.765500 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.765660 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.765822 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.765974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.766127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.766277 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.766453 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.766605 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.766756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.766915 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.767073 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.767227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.767387 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.767539 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.767688 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.767935 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.768094 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.768252 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.768426 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.768847 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.769410 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.769583 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.769729 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.770027 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.770129 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.770264 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.770524 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.770662 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.770753 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.770849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.770959 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.771305 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.771407 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.771509 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.771596 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.771690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.771777 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.771861 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.771861 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772012 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772095 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772191 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772289 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772383 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772630 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772723 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772815 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772901 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.772984 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.773068 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.773163 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.773280 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.773375 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.773461 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.773544 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.773636 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.773729 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.773824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.773920 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774012 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774097 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774181 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774277 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774363 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774363 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774516 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774599 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774696 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774782 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774865 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.774955 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.775089 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.775176 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.775273 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.775359 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.775443 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.775533 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.775630 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.775715 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.775805 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.775891 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.775975 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.776065 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.776157 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.776243 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.776326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.776409 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.776500 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.776598 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.776690 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.776775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.776858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.776949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.777040 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.777133 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.777382 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.777491 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.777579 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.777671 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.777765 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.777864 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.777972 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.778061 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.778151 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.778243 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.778329 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.778431 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.778517 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.778600 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.778691 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.778777 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.778940 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.779034 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.779524 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.779621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.779706 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.779797 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.779891 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.779977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.780161 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.780256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.780256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.780410 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.781041 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.781306 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.781402 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.781475 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.781596 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.781734 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.781831 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.781925 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.782018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.782110 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.782190 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.782277 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.782363 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.782454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.782546 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.782630 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.782727 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.782822 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.782916 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783002 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783094 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783179 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783271 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783452 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783535 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783625 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783716 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783800 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783892 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.783984 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.784069 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.784151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.784241 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.784403 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.784496 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.784582 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.784673 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.784757 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.784848 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.784941 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.785034 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.785126 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.785303 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.785400 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.785487 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.785585 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.785671 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.785755 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.785853 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.785946 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786031 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786127 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786214 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786306 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786392 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786475 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786475 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786632 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786723 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786890 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.786981 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.787078 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.787164 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.787248 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.787338 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.787439 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.787532 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.787631 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.787717 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.787801 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.787884 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.787974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.788059 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.788155 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.788247 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.788339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.788425 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.788514 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.788612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.788612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.788786 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.788876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.788960 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.789051 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.789145 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.789256 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.789358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.789737 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.789835 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.789921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.790019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.790112 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.790206 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.790291 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.790374 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.790465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.790562 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.790707 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.790804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.790890 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.790982 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.791076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.791161 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.791309 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.791434 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.791558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.791659 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.791755 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.791847 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.791932 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.792015 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.792098 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.792180 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.792277 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.792405 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.792540 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.792642 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.792773 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.792874 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.792973 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.793058 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.793206 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.793347 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.793460 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.793579 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.793692 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.793811 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.793923 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.794041 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.794151 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.794275 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.794394 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.794504 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.794622 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.794733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.794849 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.794968 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.795099 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.795209 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.795327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.795327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.795539 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.795669 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.796407 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.796535 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.796648 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.796773 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.796894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.797007 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.797117 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.797261 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.797378 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.797488 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.797618 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.797737 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.797832 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.797918 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798009 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798101 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798199 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798293 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798378 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798464 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798554 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798639 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798735 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798821 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798906 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798979 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.798979 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.799130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.799222 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.799308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.799399 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.799544 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.799840 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.799942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800435 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800530 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800616 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800700 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800784 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800875 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.800969 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.801061 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.801147 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.801408 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.801547 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.801670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.801792 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.801912 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.802032 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.802032 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.802032 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.802347 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.802458 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.802575 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.802692 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.802811 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.802952 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.803112 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.803112 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.803339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.803434 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.803720 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.803816 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.804043 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.804142 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.804357 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.804448 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.804683 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.804776 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.805008 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.805100 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.805348 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.805443 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.805674 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.805767 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.805984 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.806085 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.806289 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.806388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.806589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.806682 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.806893 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.806994 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.807204 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.807308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.807508 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.807608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.807811 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.807910 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.808134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.808235 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.808439 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.808531 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.808761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.808853 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.809090 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.809255 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.809515 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.809812 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.809921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.810016 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.810173 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.810267 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.810497 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.810655 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.810793 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.810892 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.811091 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.811186 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.811404 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.811548 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.811701 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.811828 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.812109 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.812226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.812410 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.812524 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.812721 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.812857 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.813019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.813117 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.813349 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.813444 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.813650 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.813759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.813974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.814076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.814277 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.814382 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.814598 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.814704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.814904 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.814997 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.815205 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.815298 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.815506 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.815608 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.815803 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.815932 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.816142 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.816242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.816446 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.816553 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.816775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.816868 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.817091 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.817263 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.817461 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.817556 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.817784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.817883 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.818089 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.818181 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.818392 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.818485 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.818700 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.818799 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.819016 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.819107 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.819320 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.819411 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.819630 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.819752 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.819944 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.820123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.820301 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.820447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.820597 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.820747 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.820889 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.821038 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.821211 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.821317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.821449 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.821567 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.821766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.821881 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.822073 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.822320 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.822420 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.822648 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.822751 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.822962 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.823080 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.823270 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.823371 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.823575 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.823675 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.823879 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.823971 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.824184 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.824283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.824484 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.824583 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.824788 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.824888 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.825093 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.825244 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.825422 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.825536 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.825746 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.825840 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.826063 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.826162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.826385 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.826520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.826718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.826817 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.827031 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.827141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.827340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.828056 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.828228 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.828329 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.828559 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.828701 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.828865 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.829066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.829163 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.829400 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.829494 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.829707 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.829825 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.830086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.830174 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.830314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.830416 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.830624 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.830718 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.830930 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.831030 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.831231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.831322 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.831534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.831627 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.831847 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.831980 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.832149 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.832262 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.832453 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.832573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.832763 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.832873 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.833063 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.833258 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.833392 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.833517 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.833693 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.833787 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.834024 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.834190 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.834325 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.834425 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.834631 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.834722 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.834943 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.835048 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.835276 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.835456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.835603 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.835767 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.835914 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.836095 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.836237 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.836416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.836553 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.836736 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.836867 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.837047 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.837206 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.837387 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.837516 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.837709 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.837826 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.838011 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.838127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.838311 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.838469 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.838718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.838921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.839010 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.839090 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.839211 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.839383 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.839527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.839810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.839953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.840152 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.840401 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.840545 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.840754 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.840864 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.841065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.841276 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.841412 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.841653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.841921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.842042 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.842126 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.842237 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.842412 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.842558 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.842746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.842875 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.843151 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.843269 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.843470 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.843662 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.843774 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.843968 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.844104 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.844269 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.844427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.844582 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.844762 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.844890 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.845103 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.845264 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.845445 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.845555 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.845762 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.845863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.846077 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.846170 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.846393 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.846494 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.846716 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.846808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.847015 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.847108 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.847340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.847433 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.847643 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.847736 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.847943 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.848035 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.848245 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.848346 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.848551 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.848643 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.848847 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.848939 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.849153 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.849317 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.849479 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.849587 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.849782 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.849889 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.850087 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.850235 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.850442 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.850544 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.850675 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.850779 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.850977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.851070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.851282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.851375 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.851583 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.851689 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.851885 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.851978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.852230 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.852321 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.852546 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.852646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.852850 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.853067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.853205 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.853409 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.853524 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.853744 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.853853 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.854066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.854167 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.854373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.854476 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.854677 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.854784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.854998 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.855098 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.855312 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.855413 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.855618 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.855841 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.855935 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.856175 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.856282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.856489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.856590 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.856796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.856888 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.857116 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.857257 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.857444 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.857544 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.857745 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.857837 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.858043 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.858155 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.858356 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.858449 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.859171 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.859457 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.859628 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.859786 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.859931 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.860081 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.860224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.860372 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.860595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.860699 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.860795 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.861000 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.861094 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.861330 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.861452 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.861649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.861742 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.861954 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.862047 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.862253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.862379 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.862556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.862661 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.862860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.863018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.863162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.863256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.863469 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.863576 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.863781 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.863898 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.864090 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.864193 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.864393 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.864503 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.864700 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.864808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.864999 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.865107 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.865326 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.865428 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.865631 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.865743 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.865933 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.866025 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.866238 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.866331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.866547 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.866649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.866851 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.866942 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.867148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.867240 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.867451 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.867556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.867754 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.867846 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.868063 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.868154 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.868365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.868465 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.868673 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.868772 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.868976 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.869076 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.869309 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.869417 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.869613 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.869713 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.869919 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.870024 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.870261 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.870366 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.870657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.870764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.870883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.870976 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.871186 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.871282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.871501 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.871593 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.871805 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.871904 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.872106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.872199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.872404 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.872514 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.872705 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.872816 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.873032 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.873135 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.873341 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.873441 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.873641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.873890 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.873985 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.874224 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.874887 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.875532 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.875949 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.876288 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.876380 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.876601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.876692 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.876937 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.877054 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.877273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.877386 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.877588 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.877687 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.877895 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.878001 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.878203 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.878297 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.878509 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.878600 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.878812 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.878913 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.879116 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.879214 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.879420 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.879524 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.879726 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.879831 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.880027 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.880126 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.880332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.880432 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.880661 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.880783 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.880940 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.881202 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.881338 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.881426 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.881685 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.881782 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.881869 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.881954 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.882189 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.882281 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.882504 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.882604 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.882811 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.882972 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.883111 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.883238 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.883422 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.883565 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.883731 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.883871 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.884041 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.884199 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.884353 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.884491 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.884634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.884772 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.884949 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.885052 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.885274 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.885377 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.885648 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.885759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.885891 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.885993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.886195 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.886313 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.886544 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.886651 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.886808 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.886931 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.887132 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.887250 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.887456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.887547 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.887760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.887853 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.888083 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.888175 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.888397 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.888488 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.888713 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.888814 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.889023 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.889122 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.889356 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.889465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.889685 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.889787 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.890027 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.890130 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.890335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.890599 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.890719 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.890916 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.891015 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.891226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.891330 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.891529 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.891630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.891836 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.891944 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.892142 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.892248 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.892449 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.892541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.892755 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.892853 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.893059 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.893173 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.893391 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.893485 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.893695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.893794 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.894003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.894110 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.894308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.894409 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.894609 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.894701 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.894914 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.895020 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.895221 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.895320 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.895523 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.895614 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.895823 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.895916 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.896124 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.896223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.896425 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.896517 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.896678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 23:37:43.896770 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.897367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.897681 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.897992 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.898300 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.898608 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.898911 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.899246 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.899580 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.899895 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.900220 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.900530 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.900852 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.901162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.901525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.901849 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.902168 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.902477 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.902809 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.903118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.903429 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.903741 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.904051 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.904360 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.904670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.905011 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.905367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.905719 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.906224 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.906549 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.906877 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.907194 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.907508 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.907840 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.908153 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.908464 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.908776 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.909090 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.909439 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.909759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.910072 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.910384 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.910700 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.911015 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.911437 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.911677 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.911987 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.912314 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.912641 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.912999 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.913340 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.913693 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.914024 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.914341 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.914655 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.914962 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:37:43.915214 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 23:37:44.049497 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO dbcounter [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] Registered counter for database nova_api Jul 21 23:37:44.066849 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO dbcounter [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] Registered counter for database nova_api Jul 21 23:37:44.069820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_db.sqlalchemy.engines [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:37:44.076238 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writer thread running {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:37:44.086323 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_db.sqlalchemy.engines [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:37:44.095288 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writer thread running {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:37:44.134318 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.context [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4f2fb103-b053-4673-9a59-2784203907e0(cell1) {{(pid=124388) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 23:37:44.138467 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:37:44.140103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:37:44.140994 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:37:44.142996 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:37:44.144953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO dbcounter [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] Registered counter for database nova_cell0 Jul 21 23:37:44.148959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO dbcounter [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] Registered counter for database nova_cell1 Jul 21 23:37:44.152513 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.context [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4f2fb103-b053-4673-9a59-2784203907e0(cell1) {{(pid=124387) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 23:37:44.157330 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:37:44.157636 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_db.sqlalchemy.engines [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:37:44.158975 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:37:44.159818 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:37:44.159934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_db.sqlalchemy.engines [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:37:44.161868 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:37:44.163879 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO dbcounter [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] Registered counter for database nova_cell0 Jul 21 23:37:44.164900 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writer thread running {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:37:44.167672 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writer thread running {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:37:44.167917 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO dbcounter [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] Registered counter for database nova_cell1 Jul 21 23:37:44.177539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_db.sqlalchemy.engines [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:37:44.180134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_db.sqlalchemy.engines [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:37:44.184325 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writer thread running {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:37:44.316854 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO dbcounter [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] Registered counter for database nova_cell0 Jul 21 23:37:44.324613 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writer thread running {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:37:44.325874 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_db.sqlalchemy.engines [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:37:44.330463 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writer thread running {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:37:44.334908 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO dbcounter [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] Registered counter for database nova_cell0 Jul 21 23:37:44.344540 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_db.sqlalchemy.engines [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:37:44.349406 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writer thread running {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:37:44.649302 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: WARNING keystonemiddleware.auth_token [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 23:37:44.657234 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: WARNING keystonemiddleware.auth_token [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 23:37:44.675668 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: WARNING keystonemiddleware.auth_token [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 23:37:44.683076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: WARNING keystonemiddleware.auth_token [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 23:37:45.001496 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: WARNING keystonemiddleware.auth_token [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 23:37:45.007864 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: WARNING keystonemiddleware.auth_token [None req-42dc944e-878c-472e-98b6-a274bc02bc28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 23:37:45.014064 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9e8e4e9c0 pid: 124388 (default app) Jul 21 23:37:45.026795 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: WARNING keystonemiddleware.auth_token [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 23:37:45.033275 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: WARNING keystonemiddleware.auth_token [None req-62f89814-616e-4067-b8f3-97f4eb8b15a3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 23:37:45.039409 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9e8e4e9c0 pid: 124387 (default app) Jul 21 23:38:25.698216 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:25.699491 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:25.700591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:25.702619 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:27.390781 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f4d0e4b5-4821-47bb-8d40-51506a411f1e tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Action: 'create', calling method: .version_select at 0x7f7d2ab58ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2015704273"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:29.713738 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f4d0e4b5-4821-47bb-8d40-51506a411f1e tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.027725 Jul 21 23:38:29.714458 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1154 bytes} [Thu Jul 21 23:38:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4031 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 23:38:29.729069 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e1e20d12-d395-4427-96ab-202851dd346b tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9b5af0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:29.900770 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e1e20d12-d395-4427-96ab-202851dd346b tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882" status: 200 len: 345 microversion: 2.1 time: 0.176828 Jul 21 23:38:29.902543 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 2/2] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:29 2022] GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:30.143258 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-022df329-0a26-4d7c-ada8-53c7738e48cb tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] Calling method '.version_select at 0x7f7d2aba0820>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:30.202603 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=3 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:30.211234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=3 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:30.212425 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=3 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:30.213139 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=3 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:30.915619 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-42c7b915-0895-4211-aeea-ad65178de7d4 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9b5c10>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:30.936040 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-022df329-0a26-4d7c-ada8-53c7738e48cb tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/70004e2f-326e-473a-b3bc-012c385c924c" status: 200 len: 350 microversion: 2.1 time: 1.387096 Jul 21 23:38:30.944494 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 1/3] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:29 2022] GET /compute/v2.1/os-volumes/70004e2f-326e-473a-b3bc-012c385c924c => generated 350 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:31.028569 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-42c7b915-0895-4211-aeea-ad65178de7d4 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882" status: 200 len: 346 microversion: 2.1 time: 0.116568 Jul 21 23:38:31.030304 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:30 2022] GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 => generated 346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:31.042811 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d42e8bf7-27e3-48df-8d18-bb607a92adad tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Action: 'create', calling method: .version_select at 0x7f7d2a9f1af0>, body: {"snapshot": {"volume_id": "1d1a7a47-ceb1-4ed8-8527-6deb8a76f882", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1577027001"}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:31.825227 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d42e8bf7-27e3-48df-8d18-bb607a92adad tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.786916 Jul 21 23:38:31.827463 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 2/5] 10.222.0.57 () {60 vars in 1161 bytes} [Thu Jul 21 23:38:31 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:31.837288 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-81244b09-8527-436e-a791-5ee06a7022de tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9cc280>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:32.294011 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-81244b09-8527-436e-a791-5ee06a7022de tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770" status: 200 len: 287 microversion: 2.1 time: 0.459735 Jul 21 23:38:32.294011 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 4/6] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 23:38:31 2022] GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770 => generated 287 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:32.304119 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8a8f5a8b-2fb7-493b-9654-abfd4e64baf8 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9b7310>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:32.355479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8a8f5a8b-2fb7-493b-9654-abfd4e64baf8 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.055056 Jul 21 23:38:32.367564 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-13cddcad-c3a9-4e4a-b705-69e6d4e4d99d tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9cc9d0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:32.368024 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1139 bytes} [Thu Jul 21 23:38:32 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:32.402879 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-13cddcad-c3a9-4e4a-b705-69e6d4e4d99d tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770" status: 200 len: 287 microversion: 2.1 time: 0.039068 Jul 21 23:38:32.405224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 23:38:32 2022] GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:33.131108 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8ce3be80-22e1-45d8-97cf-6baf3a7ec2dc tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] Calling method '.version_select at 0x7f7d2a9c6040>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:33.270381 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8ce3be80-22e1-45d8-97cf-6baf3a7ec2dc tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/001c2ed9-721d-42d7-ae35-8cac0aa2b0c8" status: 200 len: 350 microversion: 2.1 time: 0.143085 Jul 21 23:38:33.270949 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 4/9] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:33 2022] GET /compute/v2.1/os-volumes/001c2ed9-721d-42d7-ae35-8cac0aa2b0c8 => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:33.416146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3c86df78-45b9-4cd9-aa3f-37c67a8f01f5 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9ccaf0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:33.843191 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3c86df78-45b9-4cd9-aa3f-37c67a8f01f5 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770" status: 200 len: 287 microversion: 2.1 time: 0.431053 Jul 21 23:38:33.847435 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 6/10] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 23:38:33 2022] GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770 => generated 287 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:34.324748 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-524ec030-de6a-4035-8dda-de3307c1583a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Action: 'create', calling method: .version_select at 0x7f7d2a9b7af0>, body: {"keypair": {"name": "tempest-keypair-868285375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBMXH9ViBwp92wP3/TX6tMr55DJ9K8EXaB9Q8jx41Ux0CJrM3YCaodkxaDW8detHVG80J6PmwImGDolxKKHsZvBgh3j+ES5lz2Uk4SGKt1GvtzMsEEWAWYU8CrE7pNAxg=="}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:34.434124 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-524ec030-de6a-4035-8dda-de3307c1583a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Getting quotas for project 9612b265be6144809add4ce9e14ff6ee. Resources: {'key_pairs'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:38:34.456273 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-524ec030-de6a-4035-8dda-de3307c1583a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Getting quotas for user 51def40a3de745a99f67c6ef2d2bcbf6 and project 9612b265be6144809add4ce9e14ff6ee. Resources: {'key_pairs'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:38:34.568084 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-524ec030-de6a-4035-8dda-de3307c1583a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.559964 Jul 21 23:38:34.569521 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 5/11] 10.222.0.57 () {62 vars in 1199 bytes} [Thu Jul 21 23:38:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 562 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 23:38:34.861180 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-95605d61-864a-430e-8c32-1535a713c74c tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9cc4c0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:34.906469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-95605d61-864a-430e-8c32-1535a713c74c tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770" status: 200 len: 287 microversion: 2.1 time: 0.054869 Jul 21 23:38:34.912005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 7/12] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 23:38:34 2022] GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:35.923680 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0ead615a-d590-451c-b013-577999f1a6ab tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a94e1f0>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:35.986684 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0ead615a-d590-451c-b013-577999f1a6ab tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770" status: 200 len: 288 microversion: 2.1 time: 0.070484 Jul 21 23:38:35.987258 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 6/13] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 23:38:35 2022] GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770 => generated 288 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:35.998497 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-829dd4a3-48ca-4ec3-a797-ccd902cc705a tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9b5ca0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:36.148490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-829dd4a3-48ca-4ec3-a797-ccd902cc705a tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770" status: 202 len: 0 microversion: 2.1 time: 0.154487 Jul 21 23:38:36.149151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 8/14] 10.222.0.57 () {58 vars in 1253 bytes} [Thu Jul 21 23:38:35 2022] DELETE /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:38:36.158411 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-16acd270-d0b9-49e0-8ca2-f8eeb6ee7fb4 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9f18b0>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:36.183187 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-02484b75-9f1f-4fbd-a8a0-7206852c8763 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] Calling method '.version_select at 0x7f7d2a9d8160>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:36.227270 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-16acd270-d0b9-49e0-8ca2-f8eeb6ee7fb4 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770" status: 200 len: 287 microversion: 2.1 time: 0.072444 Jul 21 23:38:36.228078 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 7/15] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 23:38:36 2022] GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:36.313844 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-02484b75-9f1f-4fbd-a8a0-7206852c8763 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/0b9957ca-5436-477a-adfc-4884acd61a06" status: 200 len: 350 microversion: 2.1 time: 0.138159 Jul 21 23:38:36.314944 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 9/16] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:36 2022] GET /compute/v2.1/os-volumes/0b9957ca-5436-477a-adfc-4884acd61a06 => generated 350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:36.328247 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-667a9775-9d55-4f2d-8724-a419efdcec3a tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] Calling method '.version_select at 0x7f7d2a94e160>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:36.495767 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-667a9775-9d55-4f2d-8724-a419efdcec3a tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.172039 Jul 21 23:38:36.504233 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 8/17] 10.222.0.57 () {58 vars in 1133 bytes} [Thu Jul 21 23:38:36 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:36.518669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9ecb2c16-79d7-4f89-a789-03fcd8e51e23 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] Calling method '.version_select at 0x7f7d2a9b5b80>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:36.731317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9ecb2c16-79d7-4f89-a789-03fcd8e51e23 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.225684 Jul 21 23:38:36.732219 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 10/18] 10.222.0.57 () {58 vars in 1148 bytes} [Thu Jul 21 23:38:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:36.744521 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-95ad7f65-4166-4f22-8e5c-4e765ee5fe96 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] Calling method '.version_select at 0x7f7d2a0dd040>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:36.858342 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-95ad7f65-4166-4f22-8e5c-4e765ee5fe96 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.117964 Jul 21 23:38:36.860359 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 9/19] 10.222.0.57 () {58 vars in 1133 bytes} [Thu Jul 21 23:38:36 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:36.873500 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0e56fd17-b317-47f4-985d-5ea5f13daab6 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] Calling method '.version_select at 0x7f7d2a9cc700>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:37.024449 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0e56fd17-b317-47f4-985d-5ea5f13daab6 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.156818 Jul 21 23:38:37.032487 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 11/20] 10.222.0.57 () {58 vars in 1166 bytes} [Thu Jul 21 23:38:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:37.038464 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-40ba08d4-0dfc-4150-a0a6-c38a42d64b50 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] Calling method '.version_select at 0x7f7d2a94ea60>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:37.218930 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-40ba08d4-0dfc-4150-a0a6-c38a42d64b50 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.185051 Jul 21 23:38:37.219825 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 10/21] 10.222.0.57 () {58 vars in 1169 bytes} [Thu Jul 21 23:38:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:37.246326 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e0f380ef-3e3f-4614-9904-ef231ac39406 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9d8700>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:37.246529 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d4ba43a7-bf9e-4929-9825-aa6e979d9a71 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] Calling method '.version_select at 0x7f7d2a9f1e50>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:37.430565 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-e0f380ef-3e3f-4614-9904-ef231ac39406 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] HTTP exception thrown: Snapshot e4280194-5fcb-438a-b8a1-107ef834e770 could not be found. Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e0f380ef-3e3f-4614-9904-ef231ac39406 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Request method failure captured: Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770 HTTP/1.1 Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eNxGGHjssguJIsMFTdp02nA-MdSYzNxJ5pkRUhbR5rRBLjTLvNDQB6yyVeKTMZVfARSywWoXvIapNMGQU8eeIUB0rlOGZERUz5J5GMqdy8m0DSmA1T3_oQ-43nCIM74Xr1rtrITt0f_k1BunA68ea20Ph_4LVqFDSByTDAUNKi4nX0 Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: c1883e9325554192a01b12c38acad014 Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:38:37.435541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1883e9325554192a01b12c38acad014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c1883e9325554192a01b12c38acad014"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c1883e9325554192a01b12c38acad014", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1883e9325554192a01b12c38acad014"}]}] Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: c1883e9325554192a01b12c38acad014 Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesSnapshotsTestJSON-1584542680-project Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 2a672b88402a4db083626778d522ecb6 Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584542680-project Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Snapshot e4280194-5fcb-438a-b8a1-107ef834e770 could not be found. Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'e4280194-5fcb-438a-b8a1-107ef834e770'} Jul 21 23:38:37.436712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e4280194-5fcb-438a-b8a1-107ef834e770 could not be found. (HTTP 404) (Request-ID: req-190f9af6-ee8a-46ed-a031-18582050dece) Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:37.437471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:38:37.438297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e4280194-5fcb-438a-b8a1-107ef834e770 could not be found. Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 23:38:37.439188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e4280194-5fcb-438a-b8a1-107ef834e770 could not be found. Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e4280194-5fcb-438a-b8a1-107ef834e770 could not be found. Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e0f380ef-3e3f-4614-9904-ef231ac39406 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Returning 404 to user: Snapshot e4280194-5fcb-438a-b8a1-107ef834e770 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:38:37.440130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e0f380ef-3e3f-4614-9904-ef231ac39406 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770" status: 404 len: 111 microversion: 2.1 time: 0.202230 Jul 21 23:38:37.440826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 12/22] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 23:38:37 2022] GET /compute/v2.1/os-snapshots/e4280194-5fcb-438a-b8a1-107ef834e770 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:38:37.447365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d4ba43a7-bf9e-4929-9825-aa6e979d9a71 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.211005 Jul 21 23:38:37.448357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 11/23] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jul 21 23:38:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:37.451487 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c209ce57-ce82-499b-9c2c-17926530ed60 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9d8670>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:37.460248 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a8f0f2b7-9b67-49cd-aa78-f2e7ffa95a61 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] Calling method '.version_select at 0x7f7d2a0dd4c0>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:37.655213 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a8f0f2b7-9b67-49cd-aa78-f2e7ffa95a61 tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.198796 Jul 21 23:38:37.656286 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 12/24] 10.222.0.57 () {58 vars in 1187 bytes} [Thu Jul 21 23:38:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:37.668084 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-86a656c5-dfb1-4664-b2c5-1d3403b4d46f tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] Calling method '.version_select at 0x7f7d2a0ddc10>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:37.816253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c209ce57-ce82-499b-9c2c-17926530ed60 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882" status: 202 len: 0 microversion: 2.1 time: 0.372750 Jul 21 23:38:37.817343 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 13/25] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 23:38:37 2022] DELETE /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:38:37.827369 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-71f6c763-0cd7-4df9-8099-d3fd87acbfba tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9d8ca0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:37.941944 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-86a656c5-dfb1-4664-b2c5-1d3403b4d46f tempest-VolumesTestJSON-2002666303 tempest-VolumesTestJSON-2002666303-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.278220 Jul 21 23:38:37.942743 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 13/26] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jul 21 23:38:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:38:38.054371 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-71f6c763-0cd7-4df9-8099-d3fd87acbfba tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882" status: 200 len: 345 microversion: 2.1 time: 0.232356 Jul 21 23:38:38.055834 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 14/27] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:37 2022] GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 => generated 345 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:39.070289 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a1f47029-3b3c-48e9-98c4-c04b1795d2ac tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9b7160>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:39.148770 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-a1f47029-3b3c-48e9-98c4-c04b1795d2ac tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] HTTP exception thrown: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a1f47029-3b3c-48e9-98c4-c04b1795d2ac tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Request method failure captured: Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 HTTP/1.1 Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eNxGGHjssguJIsMFTdp02nA-MdSYzNxJ5pkRUhbR5rRBLjTLvNDQB6yyVeKTMZVfARSywWoXvIapNMGQU8eeIUB0rlOGZERUz5J5GMqdy8m0DSmA1T3_oQ-43nCIM74Xr1rtrITt0f_k1BunA68ea20Ph_4LVqFDSByTDAUNKi4nX0 Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: c1883e9325554192a01b12c38acad014 Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:38:39.154946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1883e9325554192a01b12c38acad014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c1883e9325554192a01b12c38acad014"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c1883e9325554192a01b12c38acad014", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1883e9325554192a01b12c38acad014"}]}] Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: c1883e9325554192a01b12c38acad014 Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-VolumesSnapshotsTestJSON-1584542680-project Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 2a672b88402a4db083626778d522ecb6 Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584542680-project Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': '1d1a7a47-ceb1-4ed8-8527-6deb8a76f882'} Jul 21 23:38:39.156208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. (HTTP 404) (Request-ID: req-0891d4b9-9f3b-4d9e-851f-62e525de96f0) Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:39.156951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:38:39.158162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 23:38:39.159234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a1f47029-3b3c-48e9-98c4-c04b1795d2ac tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Returning 404 to user: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:38:39.162154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a1f47029-3b3c-48e9-98c4-c04b1795d2ac tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882" status: 404 len: 109 microversion: 2.1 time: 0.092891 Jul 21 23:38:39.163759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 14/28] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:39 2022] GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:38:39.168593 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-552c99d2-8860-453b-b32e-c50d13076db1 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a9d8430>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:39.223812 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-552c99d2-8860-453b-b32e-c50d13076db1 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] HTTP exception thrown: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-552c99d2-8860-453b-b32e-c50d13076db1 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Request method failure captured: Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 HTTP/1.1 Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eNxGGHjssguJIsMFTdp02nA-MdSYzNxJ5pkRUhbR5rRBLjTLvNDQB6yyVeKTMZVfARSywWoXvIapNMGQU8eeIUB0rlOGZERUz5J5GMqdy8m0DSmA1T3_oQ-43nCIM74Xr1rtrITt0f_k1BunA68ea20Ph_4LVqFDSByTDAUNKi4nX0 Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: c1883e9325554192a01b12c38acad014 Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:38:39.226964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1883e9325554192a01b12c38acad014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c1883e9325554192a01b12c38acad014"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c1883e9325554192a01b12c38acad014", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1883e9325554192a01b12c38acad014"}]}] Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: c1883e9325554192a01b12c38acad014 Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesSnapshotsTestJSON-1584542680-project Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 2a672b88402a4db083626778d522ecb6 Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584542680-project Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '1d1a7a47-ceb1-4ed8-8527-6deb8a76f882'} Jul 21 23:38:39.228070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. (HTTP 404) (Request-ID: req-ae8e23c7-ce80-4db9-87b3-fa0dd592dcbb) Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:39.228942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:38:39.229863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 23:38:39.230751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:38:39.232412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.232412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.232412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:39.232412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.232412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.232412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:39.232412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:39.232412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:38:39.232412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:38:39.232412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.232412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.233913 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-552c99d2-8860-453b-b32e-c50d13076db1 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Returning 404 to user: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:38:39.235032 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-552c99d2-8860-453b-b32e-c50d13076db1 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882" status: 404 len: 109 microversion: 2.1 time: 0.070940 Jul 21 23:38:39.236954 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 15/29] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 23:38:39 2022] DELETE /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:38:39.247768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9ab7142c-661a-4d22-9b1f-775937c44209 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Calling method '.version_select at 0x7f7d2a94e160>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:39.342548 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-9ab7142c-661a-4d22-9b1f-775937c44209 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] HTTP exception thrown: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9ab7142c-661a-4d22-9b1f-775937c44209 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Request method failure captured: Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 HTTP/1.1 Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eNxGGHjssguJIsMFTdp02nA-MdSYzNxJ5pkRUhbR5rRBLjTLvNDQB6yyVeKTMZVfARSywWoXvIapNMGQU8eeIUB0rlOGZERUz5J5GMqdy8m0DSmA1T3_oQ-43nCIM74Xr1rtrITt0f_k1BunA68ea20Ph_4LVqFDSByTDAUNKi4nX0 Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: c1883e9325554192a01b12c38acad014 Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:38:39.345479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1883e9325554192a01b12c38acad014"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c1883e9325554192a01b12c38acad014"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c1883e9325554192a01b12c38acad014", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1883e9325554192a01b12c38acad014"}]}] Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: c1883e9325554192a01b12c38acad014 Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584542680 Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-VolumesSnapshotsTestJSON-1584542680-project Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 2a672b88402a4db083626778d522ecb6 Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584542680-project Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': '1d1a7a47-ceb1-4ed8-8527-6deb8a76f882'} Jul 21 23:38:39.346528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. (HTTP 404) (Request-ID: req-9a5d5c4a-320a-4064-8500-78e70c7ed60f) Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:39.347134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:38:39.348065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 23:38:39.348991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9ab7142c-661a-4d22-9b1f-775937c44209 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] Returning 404 to user: Volume 1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:38:39.349883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9ab7142c-661a-4d22-9b1f-775937c44209 tempest-VolumesSnapshotsTestJSON-1584542680 tempest-VolumesSnapshotsTestJSON-1584542680-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882" status: 404 len: 109 microversion: 2.1 time: 0.104043 Jul 21 23:38:39.352602 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 15/30] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:39 2022] GET /compute/v2.1/os-volumes/1d1a7a47-ceb1-4ed8-8527-6deb8a76f882 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:38:39.550302 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-280891586", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa056cf4-005e-4995-9d38-6224e7ebccf4"}], "security_groups": [{"name": "tempest-securitygroup--907728901"}], "key_name": "tempest-keypair-868285375", "user_data": "}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:40.010537 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] validate_networks() for [('fa056cf4-005e-4995-9d38-6224e7ebccf4', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:38:43.571810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-11526562", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:43.830557 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] validate_networks() for [('54f97918-47c2-4d61-9f70-7fcf49dfea51', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:38:44.132201 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:38:44.132734 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:38:44.133300 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:38:44.133816 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:38:44.134332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:38:44.181083 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:44.190481 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:44.191945 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:44.192502 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:44.305967 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Getting quotas for project 9612b265be6144809add4ce9e14ff6ee. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:38:44.333316 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Getting quotas for user 51def40a3de745a99f67c6ef2d2bcbf6 and project 9612b265be6144809add4ce9e14ff6ee. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:38:44.411727 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:38:44.428387 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:38:44.510416 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=4 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:44.647631 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6ed27345-6fb4-4d1b-9c72-f3fab37a7746 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.103406 Jul 21 23:38:44.648273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 16/31] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jul 21 23:38:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 5106 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 23:38:44.664341 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-270d512f-903a-4713-82fb-813371af68d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:44.664977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-270d512f-903a-4713-82fb-813371af68d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:45.424583 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-270d512f-903a-4713-82fb-813371af68d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:45.462030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-270d512f-903a-4713-82fb-813371af68d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:45.464195 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-270d512f-903a-4713-82fb-813371af68d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:45.467018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-270d512f-903a-4713-82fb-813371af68d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1280 microversion: 2.20 time: 0.809409 Jul 21 23:38:45.489518 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 17/32] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:38:44 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1280 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:38:46.134286 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:38:46.135283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:38:46.135979 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:38:46.139372 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:38:46.139970 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:38:46.165504 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:46.168436 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:46.172738 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:46.178314 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:46.265338 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Getting quotas for project 79b6d71ecbf94b7a81761727712881ea. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:38:46.277001 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Getting quotas for user b991805cfa834aab8dcab7d94d108ee2 and project 79b6d71ecbf94b7a81761727712881ea. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:38:46.321595 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:38:46.328790 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:38:46.452285 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3920a32d-35d1-4324-b6bc-7341a0881f7b tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] Action: 'create', calling method: .version_select at 0x7f7d297eb940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-446713381", "metadata": {"Type": "work"}}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:46.473606 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8bc2de36-0802-4eaf-9f3d-79f2317d5855 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.250491 Jul 21 23:38:46.474345 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 16/33] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:38:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 3252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:38:46.486111 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-16ea68fb-3f2f-48dc-a0e9-93591273111c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:46.486839 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-16ea68fb-3f2f-48dc-a0e9-93591273111c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:46.708403 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-16ea68fb-3f2f-48dc-a0e9-93591273111c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:46.739100 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-16ea68fb-3f2f-48dc-a0e9-93591273111c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1220 microversion: 2.1 time: 0.258197 Jul 21 23:38:46.741142 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 17/34] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:46 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1220 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:46.748734 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3969bc78-532e-40e6-ba48-2da66d193046 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:46.750197 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3969bc78-532e-40e6-ba48-2da66d193046 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:46.889663 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3969bc78-532e-40e6-ba48-2da66d193046 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:46.901784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3969bc78-532e-40e6-ba48-2da66d193046 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:46.908324 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3969bc78-532e-40e6-ba48-2da66d193046 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:46.911670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3969bc78-532e-40e6-ba48-2da66d193046 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1280 microversion: 2.20 time: 0.168459 Jul 21 23:38:46.913537 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 18/35] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:38:46 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:38:47.406977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3920a32d-35d1-4324-b6bc-7341a0881f7b tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.916066 Jul 21 23:38:47.407936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 18/36] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jul 21 23:38:45 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1918 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 23:38:47.552817 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1198598654", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "networks": [{"uuid": "0032c6d4-073b-4e65-95df-c6fe5a9753d5"}]}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:47.628788 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] validate_networks() for [('0032c6d4-073b-4e65-95df-c6fe5a9753d5', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:38:47.918138 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-683006fa-f4c9-47f7-be61-1bb6dd75d09b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: .version_select at 0x7f7d297ebd30>, body: {"keypair": {"name": "tempest-keypair-1872246610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrckBHsonZwETAaOCdYr42IpZTqnyaSChk32RinYBLb0Cg7C+bIk18W2IsQS1qnncusTXDmbUcRheljg/TsfpOnXgEZfrzyHSAlIVFYssVHPPK2wCM+cB7mHKYjzhE2dg=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:47.960910 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-683006fa-f4c9-47f7-be61-1bb6dd75d09b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for project fc4faed5bed7450da8122eeb77459f3a. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:38:47.970474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-683006fa-f4c9-47f7-be61-1bb6dd75d09b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for user c44b88237c0f4ae7a31fbaaddbb2d427 and project fc4faed5bed7450da8122eeb77459f3a. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:38:48.079702 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-683006fa-f4c9-47f7-be61-1bb6dd75d09b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.670591 Jul 21 23:38:48.081623 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 19/37] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 23:38:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:48.124592 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1400740057", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:48.266917 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] validate_networks() for [('54f97918-47c2-4d61-9f70-7fcf49dfea51', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:38:48.426848 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:38:48.427674 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:38:48.428380 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:38:48.430811 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:38:48.431567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:38:48.447231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:48.448062 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:48.449083 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:48.449679 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:48.480571 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Getting quotas for project 49d99b1f2c324aef91d2b56899ff631f. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:38:48.490607 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Getting quotas for user 140a9484151c4904a25b6056f2e49520 and project 49d99b1f2c324aef91d2b56899ff631f. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:38:48.524306 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:38:48.526501 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:38:48.629084 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-48e3ed62-5f33-42fc-915e-a2f9236c5d39 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.712393 Jul 21 23:38:48.648312 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 19/38] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:38:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:38:48.701757 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6a91cfc7-0e35-4cbb-ae3b-274fe985ec51 tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] Calling method '.version_select at 0x7f7d2a0dde50>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:48.903292 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6a91cfc7-0e35-4cbb-ae3b-274fe985ec51 tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/54ab40c2-f60d-4ef0-9027-d1024f327ffa" status: 200 len: 353 microversion: 2.1 time: 0.253526 Jul 21 23:38:48.903932 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 20/39] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:48 2022] GET /compute/v2.1/os-volumes/54ab40c2-f60d-4ef0-9027-d1024f327ffa => generated 353 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:48.916311 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3ac7cc2a-cbe7-4693-ba8f-29e53ffaa1c2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:48.916801 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3ac7cc2a-cbe7-4693-ba8f-29e53ffaa1c2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:48.931623 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3ac7cc2a-cbe7-4693-ba8f-29e53ffaa1c2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:48.932089 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3ac7cc2a-cbe7-4693-ba8f-29e53ffaa1c2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:48.932895 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3ac7cc2a-cbe7-4693-ba8f-29e53ffaa1c2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:48.953527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3ac7cc2a-cbe7-4693-ba8f-29e53ffaa1c2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:49.547336 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3ac7cc2a-cbe7-4693-ba8f-29e53ffaa1c2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:49.594971 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3ac7cc2a-cbe7-4693-ba8f-29e53ffaa1c2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:49.596532 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3ac7cc2a-cbe7-4693-ba8f-29e53ffaa1c2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:49.597776 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3ac7cc2a-cbe7-4693-ba8f-29e53ffaa1c2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1350 microversion: 2.20 time: 0.685534 Jul 21 23:38:49.598343 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:38:48 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1350 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:38:49.630606 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ec7047eb-e02c-4502-a490-21506b97fe13 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:49.632005 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ec7047eb-e02c-4502-a490-21506b97fe13 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:50.016430 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ec7047eb-e02c-4502-a490-21506b97fe13 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:50.026511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ec7047eb-e02c-4502-a490-21506b97fe13 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1215 microversion: 2.1 time: 0.422396 Jul 21 23:38:50.029989 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 22/41] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:49 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1215 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:50.052564 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f82048ed-e24c-4ddb-b2a4-6598d887445e tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] Calling method '.version_select at 0x7f7d2a00dd30>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:50.163704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f82048ed-e24c-4ddb-b2a4-6598d887445e tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/54ab40c2-f60d-4ef0-9027-d1024f327ffa" status: 200 len: 353 microversion: 2.1 time: 0.123460 Jul 21 23:38:50.164282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 23/42] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:50 2022] GET /compute/v2.1/os-volumes/54ab40c2-f60d-4ef0-9027-d1024f327ffa => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:50.178205 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bea1ee7d-da74-48e6-8301-021ec2d3ff5c tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] Calling method '.version_select at 0x7f7d28f36c10>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:50.252726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:38:50.253350 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:38:50.253641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:38:50.254058 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:38:50.254479 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:38:50.278224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:50.278678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:50.279500 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:50.279944 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:50.341951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bea1ee7d-da74-48e6-8301-021ec2d3ff5c tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/54ab40c2-f60d-4ef0-9027-d1024f327ffa" status: 202 len: 0 microversion: 2.1 time: 0.167088 Jul 21 23:38:50.346918 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 24/43] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 23:38:50 2022] DELETE /compute/v2.1/os-volumes/54ab40c2-f60d-4ef0-9027-d1024f327ffa => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:38:50.351724 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4ca1d260-9033-4e22-8a77-2c8fbd792d79 tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] Calling method '.version_select at 0x7f7d28f36040>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:50.392239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Getting quotas for project 79b6d71ecbf94b7a81761727712881ea. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:38:50.412912 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Getting quotas for user b991805cfa834aab8dcab7d94d108ee2 and project 79b6d71ecbf94b7a81761727712881ea. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:38:50.509248 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:38:50.520020 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4ca1d260-9033-4e22-8a77-2c8fbd792d79 tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/54ab40c2-f60d-4ef0-9027-d1024f327ffa" status: 200 len: 352 microversion: 2.1 time: 0.171961 Jul 21 23:38:50.523915 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:38:50.525120 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 25/44] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:50 2022] GET /compute/v2.1/os-volumes/54ab40c2-f60d-4ef0-9027-d1024f327ffa => generated 352 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:38:50.616043 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-495ae5d4-3cbb-4609-a434-b7610baf12a2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:50.616917 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-495ae5d4-3cbb-4609-a434-b7610baf12a2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:50.627677 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-495ae5d4-3cbb-4609-a434-b7610baf12a2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:50.628135 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-495ae5d4-3cbb-4609-a434-b7610baf12a2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:50.629416 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-495ae5d4-3cbb-4609-a434-b7610baf12a2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:50.656736 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-495ae5d4-3cbb-4609-a434-b7610baf12a2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:50.666851 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cdbb8bf2-9892-42b4-a7f1-63ef50a75f71 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.582492 Jul 21 23:38:50.667799 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 20/45] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:38:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:38:50.695413 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3cc30b56-fc0a-4e7b-83e1-ab6842990f31 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:50.698224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3cc30b56-fc0a-4e7b-83e1-ab6842990f31 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:51.344537 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-495ae5d4-3cbb-4609-a434-b7610baf12a2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:51.359455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-495ae5d4-3cbb-4609-a434-b7610baf12a2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:51.361574 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-495ae5d4-3cbb-4609-a434-b7610baf12a2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:51.364072 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-495ae5d4-3cbb-4609-a434-b7610baf12a2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1338 microversion: 2.20 time: 0.751504 Jul 21 23:38:51.379923 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 26/46] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:38:50 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1338 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:38:51.390362 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a24fec01-b176-48e9-8a05-554723abef86 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:51.391696 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-a24fec01-b176-48e9-8a05-554723abef86 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:51.402093 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a24fec01-b176-48e9-8a05-554723abef86 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:51.402829 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a24fec01-b176-48e9-8a05-554723abef86 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:51.405089 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a24fec01-b176-48e9-8a05-554723abef86 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:51.405749 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a24fec01-b176-48e9-8a05-554723abef86 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:51.456448 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3cc30b56-fc0a-4e7b-83e1-ab6842990f31 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:51.479173 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3cc30b56-fc0a-4e7b-83e1-ab6842990f31 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1222 microversion: 2.1 time: 0.804867 Jul 21 23:38:51.479775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 21/47] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:50 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1222 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:38:51.533687 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-39e22230-f422-4e5d-8a6c-ec6acc9352b8 tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] Calling method '.version_select at 0x7f7d29815550>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:51.790283 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-39e22230-f422-4e5d-8a6c-ec6acc9352b8 tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] HTTP exception thrown: Volume 54ab40c2-f60d-4ef0-9027-d1024f327ffa could not be found. Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-39e22230-f422-4e5d-8a6c-ec6acc9352b8 tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] Request method failure captured: Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/os-volumes/54ab40c2-f60d-4ef0-9027-d1024f327ffa HTTP/1.1 Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOEnMWcXCX_TsheX97PDO1GaJTPX8-PHkYNetnM3J0AJnpkc0tkHlzdNHx_A1nqpIJOF0FMLHpMsuif9HvHA94bjFOBkzunVT7sy0dpN2MIgaXNuxywc0OgqFZNw9MnUC_olxXMDgg-GldE4ZGticLemw8r-IuatNOwZcpO7zm2Dck Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 3ff965335f414d21bbe95afb849a6333 Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesGetTestJSON-1564677095 Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:38:51.793273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3ff965335f414d21bbe95afb849a6333"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3ff965335f414d21bbe95afb849a6333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3ff965335f414d21bbe95afb849a6333", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3ff965335f414d21bbe95afb849a6333"}]}] Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesGetTestJSON-1564677095 Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 3ff965335f414d21bbe95afb849a6333 Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesGetTestJSON-1564677095 Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesGetTestJSON-1564677095-project Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 6326949721c947e6ad5d26fdc10ec542 Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesGetTestJSON-1564677095-project Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Volume 54ab40c2-f60d-4ef0-9027-d1024f327ffa could not be found. Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '54ab40c2-f60d-4ef0-9027-d1024f327ffa'} Jul 21 23:38:51.795520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54ab40c2-f60d-4ef0-9027-d1024f327ffa could not be found. (HTTP 404) (Request-ID: req-f838d280-683a-45b7-87b6-6b2d2ace2704) Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:51.796630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:38:51.797813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54ab40c2-f60d-4ef0-9027-d1024f327ffa could not be found. Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 23:38:51.799018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54ab40c2-f60d-4ef0-9027-d1024f327ffa could not be found. Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54ab40c2-f60d-4ef0-9027-d1024f327ffa could not be found. Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-39e22230-f422-4e5d-8a6c-ec6acc9352b8 tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] Returning 404 to user: Volume 54ab40c2-f60d-4ef0-9027-d1024f327ffa could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-39e22230-f422-4e5d-8a6c-ec6acc9352b8 tempest-VolumesGetTestJSON-1564677095 tempest-VolumesGetTestJSON-1564677095-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/54ab40c2-f60d-4ef0-9027-d1024f327ffa" status: 404 len: 109 microversion: 2.1 time: 0.266237 Jul 21 23:38:51.801849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 22/48] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:51 2022] GET /compute/v2.1/os-volumes/54ab40c2-f60d-4ef0-9027-d1024f327ffa => generated 109 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:38:51.947195 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a24fec01-b176-48e9-8a05-554723abef86 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:51.962922 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a24fec01-b176-48e9-8a05-554723abef86 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1273 microversion: 2.1 time: 0.579644 Jul 21 23:38:51.974896 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 27/49] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:51 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1273 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:52.388943 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1835785f-dc19-48dc-94d8-074d72d9693a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:52.389752 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1835785f-dc19-48dc-94d8-074d72d9693a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:52.431033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1835785f-dc19-48dc-94d8-074d72d9693a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:52.431533 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1835785f-dc19-48dc-94d8-074d72d9693a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:52.432369 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1835785f-dc19-48dc-94d8-074d72d9693a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:52.448171 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1835785f-dc19-48dc-94d8-074d72d9693a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:52.498526 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b5d809c2-b283-4f96-85a0-7c3e9afc3d7c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:52.499768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b5d809c2-b283-4f96-85a0-7c3e9afc3d7c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:52.519150 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b5d809c2-b283-4f96-85a0-7c3e9afc3d7c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:52.520896 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b5d809c2-b283-4f96-85a0-7c3e9afc3d7c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:52.523804 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b5d809c2-b283-4f96-85a0-7c3e9afc3d7c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:52.525727 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b5d809c2-b283-4f96-85a0-7c3e9afc3d7c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:52.991590 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1835785f-dc19-48dc-94d8-074d72d9693a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:53.018052 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1835785f-dc19-48dc-94d8-074d72d9693a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:53.020187 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1835785f-dc19-48dc-94d8-074d72d9693a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:53.021626 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1835785f-dc19-48dc-94d8-074d72d9693a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1338 microversion: 2.20 time: 0.640858 Jul 21 23:38:53.034410 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 23/50] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:38:52 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1338 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:38:53.039820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3bba77a4-9350-4d95-bb04-1bf7879d99f3 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:53.040677 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3bba77a4-9350-4d95-bb04-1bf7879d99f3 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:53.058844 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3bba77a4-9350-4d95-bb04-1bf7879d99f3 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:53.060592 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3bba77a4-9350-4d95-bb04-1bf7879d99f3 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:53.062087 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3bba77a4-9350-4d95-bb04-1bf7879d99f3 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:53.065726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3bba77a4-9350-4d95-bb04-1bf7879d99f3 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:53.271354 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3bba77a4-9350-4d95-bb04-1bf7879d99f3 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:53.284221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3bba77a4-9350-4d95-bb04-1bf7879d99f3 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1273 microversion: 2.1 time: 0.248352 Jul 21 23:38:53.304672 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 24/51] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:53 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:53.391137 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b5d809c2-b283-4f96-85a0-7c3e9afc3d7c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:53.416088 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b5d809c2-b283-4f96-85a0-7c3e9afc3d7c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1218 microversion: 2.1 time: 0.922311 Jul 21 23:38:53.417807 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 28/52] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:52 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1218 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:54.041754 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-14ba8d2e-321d-4365-b918-0f34004b60a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:54.043348 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-14ba8d2e-321d-4365-b918-0f34004b60a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:54.064337 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14ba8d2e-321d-4365-b918-0f34004b60a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:54.065043 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14ba8d2e-321d-4365-b918-0f34004b60a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:54.069340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14ba8d2e-321d-4365-b918-0f34004b60a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:54.078307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14ba8d2e-321d-4365-b918-0f34004b60a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:54.300996 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-fd69d80a-c719-472e-b09d-c8d8d1a57715 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:54.301751 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-fd69d80a-c719-472e-b09d-c8d8d1a57715 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:54.319676 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fd69d80a-c719-472e-b09d-c8d8d1a57715 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:54.320579 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fd69d80a-c719-472e-b09d-c8d8d1a57715 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:54.325902 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fd69d80a-c719-472e-b09d-c8d8d1a57715 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:54.328618 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fd69d80a-c719-472e-b09d-c8d8d1a57715 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:54.935841 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-14ba8d2e-321d-4365-b918-0f34004b60a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:54.950757 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-14ba8d2e-321d-4365-b918-0f34004b60a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:54.955352 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-14ba8d2e-321d-4365-b918-0f34004b60a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:54.956526 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-14ba8d2e-321d-4365-b918-0f34004b60a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1338 microversion: 2.20 time: 0.920352 Jul 21 23:38:54.968540 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 25/53] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:38:54 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1338 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:38:54.974609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1ffcb586-81f1-4808-b77c-3bbc4ad10be8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:54.975479 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1ffcb586-81f1-4808-b77c-3bbc4ad10be8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:54.983489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ffcb586-81f1-4808-b77c-3bbc4ad10be8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:54.984338 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ffcb586-81f1-4808-b77c-3bbc4ad10be8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:54.985444 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ffcb586-81f1-4808-b77c-3bbc4ad10be8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:54.986115 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ffcb586-81f1-4808-b77c-3bbc4ad10be8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:55.103775 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-fd69d80a-c719-472e-b09d-c8d8d1a57715 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:55.130362 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-fd69d80a-c719-472e-b09d-c8d8d1a57715 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1273 microversion: 2.1 time: 0.833050 Jul 21 23:38:55.132733 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 29/54] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:54 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1273 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:38:55.142253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1ffcb586-81f1-4808-b77c-3bbc4ad10be8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:55.153384 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1ffcb586-81f1-4808-b77c-3bbc4ad10be8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1282 microversion: 2.1 time: 0.182420 Jul 21 23:38:55.153586 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-582936387", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db7b04fe-74b8-4a1d-b84d-14b166fb83d5"}], "security_groups": [{"name": "tempest-securitygroup--1926613364"}], "key_name": "tempest-keypair-1872246610", "user_data": "}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:55.155595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 26/55] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:54 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:55.743345 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] validate_networks() for [('db7b04fe-74b8-4a1d-b84d-14b166fb83d5', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:38:55.976391 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0052795a-d076-4652-82ed-1208397adfb9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:55.977023 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0052795a-d076-4652-82ed-1208397adfb9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:56.002802 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0052795a-d076-4652-82ed-1208397adfb9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:56.003270 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0052795a-d076-4652-82ed-1208397adfb9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:56.004102 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0052795a-d076-4652-82ed-1208397adfb9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:56.013799 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0052795a-d076-4652-82ed-1208397adfb9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:56.622883 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0052795a-d076-4652-82ed-1208397adfb9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:56.654855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0052795a-d076-4652-82ed-1208397adfb9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:56.669156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0052795a-d076-4652-82ed-1208397adfb9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:56.681756 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0052795a-d076-4652-82ed-1208397adfb9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.705090 Jul 21 23:38:56.687156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 27/56] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:38:55 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:38:56.712780 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fcdb951a-f10d-4d35-ab47-f29fd6ebf577 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:56.722258 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fcdb951a-f10d-4d35-ab47-f29fd6ebf577 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:56.744260 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fcdb951a-f10d-4d35-ab47-f29fd6ebf577 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:56.753517 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fcdb951a-f10d-4d35-ab47-f29fd6ebf577 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:56.758590 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fcdb951a-f10d-4d35-ab47-f29fd6ebf577 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:56.759439 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fcdb951a-f10d-4d35-ab47-f29fd6ebf577 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:57.500589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-fcdb951a-f10d-4d35-ab47-f29fd6ebf577 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:57.516857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fcdb951a-f10d-4d35-ab47-f29fd6ebf577 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1273 microversion: 2.1 time: 0.823221 Jul 21 23:38:57.519225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 28/57] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:56 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1273 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:57.545178 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6b8cd184-5ff0-4d6e-a492-869632355a27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:57.546881 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6b8cd184-5ff0-4d6e-a492-869632355a27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:57.555322 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6b8cd184-5ff0-4d6e-a492-869632355a27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:57.556413 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6b8cd184-5ff0-4d6e-a492-869632355a27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:57.558143 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6b8cd184-5ff0-4d6e-a492-869632355a27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:57.559886 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6b8cd184-5ff0-4d6e-a492-869632355a27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:57.686098 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:38:57.686678 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:38:57.687394 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:38:57.688270 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:38:57.688959 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:38:57.728012 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:57.731589 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:57.732686 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:57.733599 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:57.792695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for project fc4faed5bed7450da8122eeb77459f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:38:57.803579 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for user c44b88237c0f4ae7a31fbaaddbb2d427 and project fc4faed5bed7450da8122eeb77459f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:38:57.834005 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:38:57.836509 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:38:57.990635 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6a7c5ab9-5c5c-4ef2-bf01-3c128cbf73e7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.852191 Jul 21 23:38:57.992435 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 30/58] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:38:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 2859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:38:58.008617 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0e27247a-a2b3-4aa2-a4b7-5378669f384d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:58.020145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0e27247a-a2b3-4aa2-a4b7-5378669f384d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:58.048743 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e27247a-a2b3-4aa2-a4b7-5378669f384d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:58.052320 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e27247a-a2b3-4aa2-a4b7-5378669f384d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:58.055659 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e27247a-a2b3-4aa2-a4b7-5378669f384d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:58.060717 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e27247a-a2b3-4aa2-a4b7-5378669f384d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:58.174962 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6b8cd184-5ff0-4d6e-a492-869632355a27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:58.188317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6b8cd184-5ff0-4d6e-a492-869632355a27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1280 microversion: 2.1 time: 0.667532 Jul 21 23:38:58.189073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 29/59] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:57 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1280 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:58.550151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-705218dc-bcf1-4d86-b353-5fc801a98c56 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Action: 'create', calling method: .version_select at 0x7f7d28ef2d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1089068706", "metadata": {"Type": "work"}}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-705218dc-bcf1-4d86-b353-5fc801a98c56 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Request method failure captured: Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 122 Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOR-ZWgNaUK_VadCDsjuAkpK7Bi4OOtHu6khcViiIbVGipqxzdQ7vSJgtjH6KMpdHAX1fKKNef0Vw3T2jPS1f5ZBeeLiHNvs0sl6vDMN54zV1eePrQGWkcM1B4NEasi_BA5kMSUwXcqtqwAmlsSpR41r05qJlwaQsJNzLHtaWfrOxE Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:38:58.576340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c3298399b49e4cef9fff71b91c0ee4fa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}] Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 4446ea3c59b54272aaa662ccd7d1d971 Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1089068706", "metadata": {"Type": "work"}}} Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: Jul 21 23:38:58.577527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1089068706', 'metadata': {'Type': 'work'}}}} Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise error Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:38:58.578273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 23:38:58.579456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 23:38:58.580427 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 23:38:58.580427 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.580427 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-705218dc-bcf1-4d86-b353-5fc801a98c56 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:38:58.580427 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-705218dc-bcf1-4d86-b353-5fc801a98c56 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.386103 Jul 21 23:38:58.581102 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 30/60] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jul 21 23:38:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 388 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:38:58.587284 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4941be36-7579-4c14-891f-4eaf5398a55f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:58.588533 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4941be36-7579-4c14-891f-4eaf5398a55f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:58.665401 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0e27247a-a2b3-4aa2-a4b7-5378669f384d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:58.682424 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0e27247a-a2b3-4aa2-a4b7-5378669f384d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:58.687909 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0e27247a-a2b3-4aa2-a4b7-5378669f384d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:58.696736 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0e27247a-a2b3-4aa2-a4b7-5378669f384d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.692077 Jul 21 23:38:58.698113 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 31/61] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:38:57 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:38:58.712580 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6d54fef5-0d2e-4e08-9008-e241d3bced15 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:58.713497 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6d54fef5-0d2e-4e08-9008-e241d3bced15 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:58.724265 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d54fef5-0d2e-4e08-9008-e241d3bced15 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:58.725091 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d54fef5-0d2e-4e08-9008-e241d3bced15 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:58.726428 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d54fef5-0d2e-4e08-9008-e241d3bced15 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:58.727394 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d54fef5-0d2e-4e08-9008-e241d3bced15 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:58.742253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4941be36-7579-4c14-891f-4eaf5398a55f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:58.757562 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4941be36-7579-4c14-891f-4eaf5398a55f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1241 microversion: 2.1 time: 0.174684 Jul 21 23:38:58.758636 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 31/62] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:58 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:58.767768 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f1190b17-bf1f-4a49-b024-3233283618b5 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Action: 'create', calling method: .version_select at 0x7f7d28ee20d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-694857400", "metadata": {"Type": "work"}}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f1190b17-bf1f-4a49-b024-3233283618b5 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Request method failure captured: Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 119 Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOR-ZWgNaUK_VadCDsjuAkpK7Bi4OOtHu6khcViiIbVGipqxzdQ7vSJgtjH6KMpdHAX1fKKNef0Vw3T2jPS1f5ZBeeLiHNvs0sl6vDMN54zV1eePrQGWkcM1B4NEasi_BA5kMSUwXcqtqwAmlsSpR41r05qJlwaQsJNzLHtaWfrOxE Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:38:58.777441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c3298399b49e4cef9fff71b91c0ee4fa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}] Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 4446ea3c59b54272aaa662ccd7d1d971 Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-694857400", "metadata": {"Type": "work"}}} Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: Jul 21 23:38:58.781225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-694857400', 'metadata': {'Type': 'work'}}}} Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise error Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi '0' Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:38:58.782005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 23:38:58.783103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 23:38:58.784186 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 23:38:58.784186 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.788075 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f1190b17-bf1f-4a49-b024-3233283618b5 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:38:58.795083 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f1190b17-bf1f-4a49-b024-3233283618b5 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.034574 Jul 21 23:38:58.795975 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 32/63] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jul 21 23:38:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:38:58.808129 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-25574838-1499-4eb9-9036-5089c70013ac tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Action: 'create', calling method: .version_select at 0x7f7d28ef2b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-458899999", "metadata": {"Type": "work"}}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-25574838-1499-4eb9-9036-5089c70013ac tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Request method failure captured: Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 118 Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOR-ZWgNaUK_VadCDsjuAkpK7Bi4OOtHu6khcViiIbVGipqxzdQ7vSJgtjH6KMpdHAX1fKKNef0Vw3T2jPS1f5ZBeeLiHNvs0sl6vDMN54zV1eePrQGWkcM1B4NEasi_BA5kMSUwXcqtqwAmlsSpR41r05qJlwaQsJNzLHtaWfrOxE Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:38:58.813103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c3298399b49e4cef9fff71b91c0ee4fa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}] Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 4446ea3c59b54272aaa662ccd7d1d971 Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-458899999", "metadata": {"Type": "work"}}} Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: Jul 21 23:38:58.814307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-458899999', 'metadata': {'Type': 'work'}}}} Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise error Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi '' Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:38:58.814953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 23:38:58.816086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 23:38:58.817035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 23:38:58.817035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.819169 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-25574838-1499-4eb9-9036-5089c70013ac tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:38:58.820450 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-25574838-1499-4eb9-9036-5089c70013ac tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018889 Jul 21 23:38:58.821550 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jul 21 23:38:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:38:58.834008 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-640e6e70-6b26-4b01-9871-1e448acd038a tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Calling method '.version_select at 0x7f7d28ef2ca0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:58.899524 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-640e6e70-6b26-4b01-9871-1e448acd038a tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] HTTP exception thrown: Volume tempest-invalid-1934618022 could not be found. Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-640e6e70-6b26-4b01-9871-1e448acd038a tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Request method failure captured: Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1934618022 HTTP/1.1 Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOR-ZWgNaUK_VadCDsjuAkpK7Bi4OOtHu6khcViiIbVGipqxzdQ7vSJgtjH6KMpdHAX1fKKNef0Vw3T2jPS1f5ZBeeLiHNvs0sl6vDMN54zV1eePrQGWkcM1B4NEasi_BA5kMSUwXcqtqwAmlsSpR41r05qJlwaQsJNzLHtaWfrOxE Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:38:58.902482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c3298399b49e4cef9fff71b91c0ee4fa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}] Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 4446ea3c59b54272aaa662ccd7d1d971 Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Volume tempest-invalid-1934618022 could not be found. Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'tempest-invalid-1934618022'} Jul 21 23:38:58.904033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1934618022 could not be found. (HTTP 404) (Request-ID: req-2441ac9f-ff3a-414e-b7d4-19a49104a23c) Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:58.904718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:38:58.905722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1934618022 could not be found. Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:38:58.906641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1934618022 could not be found. Jul 21 23:38:58.907775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.907775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:58.907775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.907775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:58.907775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:58.907775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:58.907775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:38:58.907775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:38:58.907775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1934618022 could not be found. Jul 21 23:38:58.907775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:58.909965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-640e6e70-6b26-4b01-9871-1e448acd038a tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Returning 404 to user: Volume tempest-invalid-1934618022 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:38:58.911123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-640e6e70-6b26-4b01-9871-1e448acd038a tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1934618022" status: 404 len: 99 microversion: 2.1 time: 0.083383 Jul 21 23:38:58.912223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 34/65] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jul 21 23:38:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1934618022 => generated 99 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 21 23:38:58.921978 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5758facf-8ae0-4c98-a1de-53c4af8eb68e tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004813 Jul 21 23:38:58.923062 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 35/66] 10.222.0.57 () {58 vars in 1139 bytes} [Thu Jul 21 23:38:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 23:38:58.933372 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9e025ec1-5503-4e7e-a868-4f5fd7738aee tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004377 Jul 21 23:38:58.934976 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 36/67] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jul 21 23:38:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 21 23:38:58.945122 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7c0f89f6-9f08-4a44-88cd-e91ad1229c76 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Calling method '.version_select at 0x7f7d28ee2af0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:58.995539 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-7c0f89f6-9f08-4a44-88cd-e91ad1229c76 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] HTTP exception thrown: Volume 6f8c9543-992a-46bc-848a-5df9f8ca89e5 could not be found. Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7c0f89f6-9f08-4a44-88cd-e91ad1229c76 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Request method failure captured: Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/os-volumes/6f8c9543-992a-46bc-848a-5df9f8ca89e5 HTTP/1.1 Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOR-ZWgNaUK_VadCDsjuAkpK7Bi4OOtHu6khcViiIbVGipqxzdQ7vSJgtjH6KMpdHAX1fKKNef0Vw3T2jPS1f5ZBeeLiHNvs0sl6vDMN54zV1eePrQGWkcM1B4NEasi_BA5kMSUwXcqtqwAmlsSpR41r05qJlwaQsJNzLHtaWfrOxE Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:38:58.998824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c3298399b49e4cef9fff71b91c0ee4fa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}] Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 4446ea3c59b54272aaa662ccd7d1d971 Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Volume 6f8c9543-992a-46bc-848a-5df9f8ca89e5 could not be found. Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '6f8c9543-992a-46bc-848a-5df9f8ca89e5'} Jul 21 23:38:59.000239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f8c9543-992a-46bc-848a-5df9f8ca89e5 could not be found. (HTTP 404) (Request-ID: req-a2e3af20-5d03-4fc4-a07c-491dfb44dc45) Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:59.001073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:38:59.002291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f8c9543-992a-46bc-848a-5df9f8ca89e5 could not be found. Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 23:38:59.003965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f8c9543-992a-46bc-848a-5df9f8ca89e5 could not be found. Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f8c9543-992a-46bc-848a-5df9f8ca89e5 could not be found. Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7c0f89f6-9f08-4a44-88cd-e91ad1229c76 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Returning 404 to user: Volume 6f8c9543-992a-46bc-848a-5df9f8ca89e5 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7c0f89f6-9f08-4a44-88cd-e91ad1229c76 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/6f8c9543-992a-46bc-848a-5df9f8ca89e5" status: 404 len: 109 microversion: 2.1 time: 0.062025 Jul 21 23:38:59.005690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 37/68] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 23:38:58 2022] DELETE /compute/v2.1/os-volumes/6f8c9543-992a-46bc-848a-5df9f8ca89e5 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:38:59.026743 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2900215d-c3cd-4f5b-aedc-2c25d8723761 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Calling method '.version_select at 0x7f7d297f3f70>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:59.045163 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6d54fef5-0d2e-4e08-9008-e241d3bced15 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:59.056120 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6d54fef5-0d2e-4e08-9008-e241d3bced15 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.356579 Jul 21 23:38:59.056744 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 32/69] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:58 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:59.068300 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-2900215d-c3cd-4f5b-aedc-2c25d8723761 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] HTTP exception thrown: Volume e66f848a-1630-436c-9602-1220c38d9980 could not be found. Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2900215d-c3cd-4f5b-aedc-2c25d8723761 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Request method failure captured: Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/os-volumes/e66f848a-1630-436c-9602-1220c38d9980 HTTP/1.1 Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOR-ZWgNaUK_VadCDsjuAkpK7Bi4OOtHu6khcViiIbVGipqxzdQ7vSJgtjH6KMpdHAX1fKKNef0Vw3T2jPS1f5ZBeeLiHNvs0sl6vDMN54zV1eePrQGWkcM1B4NEasi_BA5kMSUwXcqtqwAmlsSpR41r05qJlwaQsJNzLHtaWfrOxE Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:38:59.071128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c3298399b49e4cef9fff71b91c0ee4fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c3298399b49e4cef9fff71b91c0ee4fa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c3298399b49e4cef9fff71b91c0ee4fa"}]}] Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: c3298399b49e4cef9fff71b91c0ee4fa Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesNegativeTest-895264617 Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 4446ea3c59b54272aaa662ccd7d1d971 Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesNegativeTest-895264617-project Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Volume e66f848a-1630-436c-9602-1220c38d9980 could not be found. Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'e66f848a-1630-436c-9602-1220c38d9980'} Jul 21 23:38:59.072381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e66f848a-1630-436c-9602-1220c38d9980 could not be found. (HTTP 404) (Request-ID: req-df1844b4-1013-487e-889d-7d64bede9f25) Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:59.073822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:38:59.075443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e66f848a-1630-436c-9602-1220c38d9980 could not be found. Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 23:38:59.077228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e66f848a-1630-436c-9602-1220c38d9980 could not be found. Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e66f848a-1630-436c-9602-1220c38d9980 could not be found. Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2900215d-c3cd-4f5b-aedc-2c25d8723761 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] Returning 404 to user: Volume e66f848a-1630-436c-9602-1220c38d9980 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2900215d-c3cd-4f5b-aedc-2c25d8723761 tempest-VolumesNegativeTest-895264617 tempest-VolumesNegativeTest-895264617-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e66f848a-1630-436c-9602-1220c38d9980" status: 404 len: 109 microversion: 2.1 time: 0.065130 Jul 21 23:38:59.078490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 38/70] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 23:38:59 2022] GET /compute/v2.1/os-volumes/e66f848a-1630-436c-9602-1220c38d9980 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:38:59.206636 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-117a9d1f-98c5-4520-beac-97fc8cc0ffa0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:59.207261 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-117a9d1f-98c5-4520-beac-97fc8cc0ffa0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:59.219629 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-117a9d1f-98c5-4520-beac-97fc8cc0ffa0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:59.220092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-117a9d1f-98c5-4520-beac-97fc8cc0ffa0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:59.224072 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-117a9d1f-98c5-4520-beac-97fc8cc0ffa0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:59.224523 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-117a9d1f-98c5-4520-beac-97fc8cc0ffa0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:59.716203 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8247ebd2-e441-4da4-b943-55d8c673c6d7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:59.717248 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8247ebd2-e441-4da4-b943-55d8c673c6d7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:59.736910 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8247ebd2-e441-4da4-b943-55d8c673c6d7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:59.737413 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8247ebd2-e441-4da4-b943-55d8c673c6d7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:59.739103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8247ebd2-e441-4da4-b943-55d8c673c6d7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:59.739551 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8247ebd2-e441-4da4-b943-55d8c673c6d7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:59.753583 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-117a9d1f-98c5-4520-beac-97fc8cc0ffa0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:59.766269 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-117a9d1f-98c5-4520-beac-97fc8cc0ffa0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.561798 Jul 21 23:38:59.767506 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 33/71] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:59 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:38:59.780980 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7f71d0f0-a6e7-4d16-8a5a-9cccbd2f5e5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:38:59.781820 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7f71d0f0-a6e7-4d16-8a5a-9cccbd2f5e5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:38:59.803275 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f71d0f0-a6e7-4d16-8a5a-9cccbd2f5e5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:59.805917 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f71d0f0-a6e7-4d16-8a5a-9cccbd2f5e5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:59.806973 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f71d0f0-a6e7-4d16-8a5a-9cccbd2f5e5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:38:59.807786 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f71d0f0-a6e7-4d16-8a5a-9cccbd2f5e5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:38:59.889099 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7f71d0f0-a6e7-4d16-8a5a-9cccbd2f5e5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:38:59.906623 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7f71d0f0-a6e7-4d16-8a5a-9cccbd2f5e5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1245 microversion: 2.1 time: 0.133919 Jul 21 23:38:59.907398 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 34/72] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:38:59 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1245 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:00.064494 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8247ebd2-e441-4da4-b943-55d8c673c6d7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:00.074272 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-dab38785-1592-4e97-994b-3a08d952ce3a tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:00.075448 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-dab38785-1592-4e97-994b-3a08d952ce3a tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:00.079666 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8247ebd2-e441-4da4-b943-55d8c673c6d7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:00.084756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dab38785-1592-4e97-994b-3a08d952ce3a tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:00.085235 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dab38785-1592-4e97-994b-3a08d952ce3a tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:00.085823 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8247ebd2-e441-4da4-b943-55d8c673c6d7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:00.086009 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dab38785-1592-4e97-994b-3a08d952ce3a tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:00.087354 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8247ebd2-e441-4da4-b943-55d8c673c6d7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.376123 Jul 21 23:39:00.092431 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dab38785-1592-4e97-994b-3a08d952ce3a tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:00.101356 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 39/73] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:38:59 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:00.373869 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-dab38785-1592-4e97-994b-3a08d952ce3a tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:00.383920 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-dab38785-1592-4e97-994b-3a08d952ce3a tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.313109 Jul 21 23:39:00.385388 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 35/74] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:00 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:00.785023 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-00aeca3c-37a1-4dd1-bcb7-fb12560cf98d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:00.785577 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-00aeca3c-37a1-4dd1-bcb7-fb12560cf98d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:00.787583 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=4 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:00.809929 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-00aeca3c-37a1-4dd1-bcb7-fb12560cf98d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:00.810551 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-00aeca3c-37a1-4dd1-bcb7-fb12560cf98d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:00.811386 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-00aeca3c-37a1-4dd1-bcb7-fb12560cf98d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:00.811845 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-00aeca3c-37a1-4dd1-bcb7-fb12560cf98d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:00.925278 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a0e0d79a-6ee4-47a3-8449-0e8a3c598f75 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:00.929999 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-a0e0d79a-6ee4-47a3-8449-0e8a3c598f75 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:00.933263 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:00.946468 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a0e0d79a-6ee4-47a3-8449-0e8a3c598f75 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:00.947704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a0e0d79a-6ee4-47a3-8449-0e8a3c598f75 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:00.951848 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a0e0d79a-6ee4-47a3-8449-0e8a3c598f75 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:00.952518 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a0e0d79a-6ee4-47a3-8449-0e8a3c598f75 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:01.194275 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a0e0d79a-6ee4-47a3-8449-0e8a3c598f75 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:01.216312 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a0e0d79a-6ee4-47a3-8449-0e8a3c598f75 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1245 microversion: 2.1 time: 0.293369 Jul 21 23:39:01.217538 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 36/75] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:00 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1245 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:01.225260 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9377c55d-f352-4a61-9c44-acf5a2ce750b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:01.226507 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9377c55d-f352-4a61-9c44-acf5a2ce750b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:01.239047 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9377c55d-f352-4a61-9c44-acf5a2ce750b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:01.239709 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9377c55d-f352-4a61-9c44-acf5a2ce750b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:01.241222 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9377c55d-f352-4a61-9c44-acf5a2ce750b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:01.241880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9377c55d-f352-4a61-9c44-acf5a2ce750b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:01.345502 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-00aeca3c-37a1-4dd1-bcb7-fb12560cf98d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:01.354949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-00aeca3c-37a1-4dd1-bcb7-fb12560cf98d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.574163 Jul 21 23:39:01.355530 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 40/76] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:00 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:01.403175 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-67012bc2-6411-409a-aef2-84e11ec0c5b7 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:01.404056 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-67012bc2-6411-409a-aef2-84e11ec0c5b7 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:01.425751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-67012bc2-6411-409a-aef2-84e11ec0c5b7 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:01.427668 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-67012bc2-6411-409a-aef2-84e11ec0c5b7 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:01.430186 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-67012bc2-6411-409a-aef2-84e11ec0c5b7 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:01.432180 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-67012bc2-6411-409a-aef2-84e11ec0c5b7 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:02.800610 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9377c55d-f352-4a61-9c44-acf5a2ce750b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:02.819530 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9377c55d-f352-4a61-9c44-acf5a2ce750b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:02.823599 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9377c55d-f352-4a61-9c44-acf5a2ce750b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:02.830237 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9377c55d-f352-4a61-9c44-acf5a2ce750b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 1.608662 Jul 21 23:39:02.831000 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 37/77] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:01 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:02.863807 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7cf3e0f4-6305-46cd-9c8b-f4902231d67b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:02.864462 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7cf3e0f4-6305-46cd-9c8b-f4902231d67b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:02.908224 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7cf3e0f4-6305-46cd-9c8b-f4902231d67b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:02.909123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7cf3e0f4-6305-46cd-9c8b-f4902231d67b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:02.911384 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7cf3e0f4-6305-46cd-9c8b-f4902231d67b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:02.912506 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7cf3e0f4-6305-46cd-9c8b-f4902231d67b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:02.914877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-67012bc2-6411-409a-aef2-84e11ec0c5b7 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:02.931522 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-67012bc2-6411-409a-aef2-84e11ec0c5b7 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 1.532857 Jul 21 23:39:02.935732 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 41/78] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:01 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:02.955527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-26a797c7-4067-47b9-a298-807b857116c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:02.956244 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-26a797c7-4067-47b9-a298-807b857116c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:02.992071 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26a797c7-4067-47b9-a298-807b857116c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:02.992932 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26a797c7-4067-47b9-a298-807b857116c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:02.993941 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26a797c7-4067-47b9-a298-807b857116c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:02.995332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26a797c7-4067-47b9-a298-807b857116c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:03.623089 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-26a797c7-4067-47b9-a298-807b857116c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:03.640306 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-26a797c7-4067-47b9-a298-807b857116c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.702245 Jul 21 23:39:03.644206 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 42/79] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:02 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:03.657676 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7cf3e0f4-6305-46cd-9c8b-f4902231d67b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:03.671392 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7cf3e0f4-6305-46cd-9c8b-f4902231d67b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1299 microversion: 2.1 time: 0.835174 Jul 21 23:39:03.687005 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 38/80] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:02 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1299 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:03.854224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-99900afb-dee4-4be6-a7ae-df94072ab24e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:03.856130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-99900afb-dee4-4be6-a7ae-df94072ab24e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:03.888667 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99900afb-dee4-4be6-a7ae-df94072ab24e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:03.890159 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99900afb-dee4-4be6-a7ae-df94072ab24e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:03.892169 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99900afb-dee4-4be6-a7ae-df94072ab24e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:03.892709 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99900afb-dee4-4be6-a7ae-df94072ab24e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:03.955732 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-598b24e2-ec80-4dab-b294-98cb3efd065c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:03.958766 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-598b24e2-ec80-4dab-b294-98cb3efd065c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:03.968811 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-598b24e2-ec80-4dab-b294-98cb3efd065c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:03.969515 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-598b24e2-ec80-4dab-b294-98cb3efd065c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:03.970622 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-598b24e2-ec80-4dab-b294-98cb3efd065c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:03.971199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-598b24e2-ec80-4dab-b294-98cb3efd065c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:04.405392 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-99900afb-dee4-4be6-a7ae-df94072ab24e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:04.429681 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-99900afb-dee4-4be6-a7ae-df94072ab24e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:04.432862 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-99900afb-dee4-4be6-a7ae-df94072ab24e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:04.435606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-99900afb-dee4-4be6-a7ae-df94072ab24e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.589398 Jul 21 23:39:04.436530 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 43/81] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:03 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:04.985139 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-f1fae228-9707-4237-ac36-dfdafe716cac req-d396aa10-e25b-4eae-ac60-39af238dedfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c16c660c-f977-46c1-9b2a-c85d81c8368d", "tag": "e5354cca-d4b3-4289-aaf0-fb839e6ccac2"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:05.012480 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-f1fae228-9707-4237-ac36-dfdafe716cac req-d396aa10-e25b-4eae-ac60-39af238dedfc service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:05.014933 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-f1fae228-9707-4237-ac36-dfdafe716cac req-d396aa10-e25b-4eae-ac60-39af238dedfc service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:05.048738 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-f1fae228-9707-4237-ac36-dfdafe716cac req-d396aa10-e25b-4eae-ac60-39af238dedfc service nova] Creating event network-changed:e5354cca-d4b3-4289-aaf0-fb839e6ccac2 for instance c16c660c-f977-46c1-9b2a-c85d81c8368d on hv-cinder-85070 Jul 21 23:39:05.050226 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-f1fae228-9707-4237-ac36-dfdafe716cac req-d396aa10-e25b-4eae-ac60-39af238dedfc service nova] Acquired lock "compute-rpcapi-router" {{(pid=124388) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 23:39:05.052952 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b71c025d-c241-49bd-9036-4e5b02580084 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:05.054046 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b71c025d-c241-49bd-9036-4e5b02580084 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:05.055719 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b71c025d-c241-49bd-9036-4e5b02580084 None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:05.056723 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b71c025d-c241-49bd-9036-4e5b02580084 None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:05.080417 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.compute.rpcapi [None req-b71c025d-c241-49bd-9036-4e5b02580084 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 23:39:05.081922 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b71c025d-c241-49bd-9036-4e5b02580084 None None] Releasing lock "compute-rpcapi-router" {{(pid=124388) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 23:39:05.120817 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b71c025d-c241-49bd-9036-4e5b02580084 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.591074 Jul 21 23:39:05.122762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 44/82] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:39:05.144481 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d6652627-7f10-4c4f-980b-cae12b343159 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:05.145721 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d6652627-7f10-4c4f-980b-cae12b343159 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:05.159620 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d6652627-7f10-4c4f-980b-cae12b343159 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:05.161768 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d6652627-7f10-4c4f-980b-cae12b343159 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:05.163211 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d6652627-7f10-4c4f-980b-cae12b343159 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:05.164312 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d6652627-7f10-4c4f-980b-cae12b343159 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:05.742338 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d6652627-7f10-4c4f-980b-cae12b343159 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:05.754029 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d6652627-7f10-4c4f-980b-cae12b343159 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.626685 Jul 21 23:39:05.754958 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 45/83] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:05 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:05.766605 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-640b3674-b2bf-4124-8cef-2c4665015b9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:05.767471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-640b3674-b2bf-4124-8cef-2c4665015b9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:05.787339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-640b3674-b2bf-4124-8cef-2c4665015b9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:05.788049 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-640b3674-b2bf-4124-8cef-2c4665015b9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:05.789022 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-640b3674-b2bf-4124-8cef-2c4665015b9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:05.789666 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-640b3674-b2bf-4124-8cef-2c4665015b9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:05.994089 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-640b3674-b2bf-4124-8cef-2c4665015b9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:05.997690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=91 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:06.015107 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-640b3674-b2bf-4124-8cef-2c4665015b9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1299 microversion: 2.1 time: 0.257660 Jul 21 23:39:06.018437 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 46/84] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:05 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1299 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:06.039656 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bcc8a7a5-b721-49f8-8eed-06494b05ac7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:06.040327 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bcc8a7a5-b721-49f8-8eed-06494b05ac7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:06.042183 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:06.072726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcc8a7a5-b721-49f8-8eed-06494b05ac7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:06.076291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcc8a7a5-b721-49f8-8eed-06494b05ac7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:06.078537 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcc8a7a5-b721-49f8-8eed-06494b05ac7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:06.083037 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcc8a7a5-b721-49f8-8eed-06494b05ac7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:06.146805 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-598b24e2-ec80-4dab-b294-98cb3efd065c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:06.158998 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-598b24e2-ec80-4dab-b294-98cb3efd065c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 2.210998 Jul 21 23:39:06.162352 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 39/85] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:03 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:06.583334 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bcc8a7a5-b721-49f8-8eed-06494b05ac7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:06.598934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bcc8a7a5-b721-49f8-8eed-06494b05ac7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:06.604490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bcc8a7a5-b721-49f8-8eed-06494b05ac7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:06.608489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bcc8a7a5-b721-49f8-8eed-06494b05ac7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.583799 Jul 21 23:39:06.610100 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 47/86] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:06 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:06.772028 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e0385e39-ab68-4524-b0fc-7026d30eeec8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:06.772719 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e0385e39-ab68-4524-b0fc-7026d30eeec8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:06.784670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e0385e39-ab68-4524-b0fc-7026d30eeec8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:06.784670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e0385e39-ab68-4524-b0fc-7026d30eeec8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:06.786792 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e0385e39-ab68-4524-b0fc-7026d30eeec8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:06.787547 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e0385e39-ab68-4524-b0fc-7026d30eeec8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:07.035021 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a39167db-74a8-452a-9ba1-0b945457ba48 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:07.036851 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a39167db-74a8-452a-9ba1-0b945457ba48 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:07.057526 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a39167db-74a8-452a-9ba1-0b945457ba48 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:07.058117 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a39167db-74a8-452a-9ba1-0b945457ba48 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:07.059239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a39167db-74a8-452a-9ba1-0b945457ba48 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:07.069775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a39167db-74a8-452a-9ba1-0b945457ba48 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:07.403626 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a39167db-74a8-452a-9ba1-0b945457ba48 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:07.430191 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a39167db-74a8-452a-9ba1-0b945457ba48 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1299 microversion: 2.1 time: 0.397329 Jul 21 23:39:07.434181 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 48/87] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:07 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1299 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:07.458575 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-13ce0829-5e29-4b78-8ab6-ca76f56cd183 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:07.462222 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-13ce0829-5e29-4b78-8ab6-ca76f56cd183 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:07.486314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-13ce0829-5e29-4b78-8ab6-ca76f56cd183 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:07.486952 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-13ce0829-5e29-4b78-8ab6-ca76f56cd183 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:07.487873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-13ce0829-5e29-4b78-8ab6-ca76f56cd183 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:07.488580 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-13ce0829-5e29-4b78-8ab6-ca76f56cd183 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:07.776442 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=6 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:07.824117 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=24 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:07.964107 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e0385e39-ab68-4524-b0fc-7026d30eeec8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:07.982848 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e0385e39-ab68-4524-b0fc-7026d30eeec8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 1.209359 Jul 21 23:39:07.984315 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 40/88] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:06 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:07.989273 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0ba539ce-178f-4e6f-ba0c-8e16f5367300 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:07.996850 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0ba539ce-178f-4e6f-ba0c-8e16f5367300 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:08.015757 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0ba539ce-178f-4e6f-ba0c-8e16f5367300 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:08.018586 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0ba539ce-178f-4e6f-ba0c-8e16f5367300 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:08.024175 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0ba539ce-178f-4e6f-ba0c-8e16f5367300 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:08.026418 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0ba539ce-178f-4e6f-ba0c-8e16f5367300 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:08.140056 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=100 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:08.308247 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-13ce0829-5e29-4b78-8ab6-ca76f56cd183 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:08.317715 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-13ce0829-5e29-4b78-8ab6-ca76f56cd183 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.879293 Jul 21 23:39:08.331657 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 49/89] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:07 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:08.559284 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-b272bf7b-548c-4fc6-86c3-5467242fc216 req-6f3f0d6b-10f4-40bd-aa10-784b3a724481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af6350f-5066-435f-bf01-5541dd1d3b18", "tag": "365fc751-fe38-4f1c-aa15-d43a2299f5d0"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:08.568834 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b272bf7b-548c-4fc6-86c3-5467242fc216 req-6f3f0d6b-10f4-40bd-aa10-784b3a724481 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:08.569468 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b272bf7b-548c-4fc6-86c3-5467242fc216 req-6f3f0d6b-10f4-40bd-aa10-784b3a724481 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:08.584917 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-b272bf7b-548c-4fc6-86c3-5467242fc216 req-6f3f0d6b-10f4-40bd-aa10-784b3a724481 service nova] Creating event network-changed:365fc751-fe38-4f1c-aa15-d43a2299f5d0 for instance 7af6350f-5066-435f-bf01-5541dd1d3b18 on hv-cinder-85070 Jul 21 23:39:08.590325 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-b272bf7b-548c-4fc6-86c3-5467242fc216 req-6f3f0d6b-10f4-40bd-aa10-784b3a724481 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265825 Jul 21 23:39:08.591566 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 50/90] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:39:08.597089 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-945dd757-8f78-477a-b0c6-31eaa207fa5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:08.597877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-945dd757-8f78-477a-b0c6-31eaa207fa5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:08.607717 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-945dd757-8f78-477a-b0c6-31eaa207fa5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:08.608174 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-945dd757-8f78-477a-b0c6-31eaa207fa5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:08.610815 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-945dd757-8f78-477a-b0c6-31eaa207fa5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:08.611264 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-945dd757-8f78-477a-b0c6-31eaa207fa5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:08.702027 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-945dd757-8f78-477a-b0c6-31eaa207fa5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:08.713149 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-945dd757-8f78-477a-b0c6-31eaa207fa5f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1299 microversion: 2.1 time: 0.120102 Jul 21 23:39:08.714686 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 51/91] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:08 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:08.989391 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0ba539ce-178f-4e6f-ba0c-8e16f5367300 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:09.000442 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0ba539ce-178f-4e6f-ba0c-8e16f5367300 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:09.001283 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d1864d67-f58c-4335-9e3d-ad1db7207044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:09.002332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d1864d67-f58c-4335-9e3d-ad1db7207044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:09.005638 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0ba539ce-178f-4e6f-ba0c-8e16f5367300 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:09.007331 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0ba539ce-178f-4e6f-ba0c-8e16f5367300 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 1.021868 Jul 21 23:39:09.017049 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=22 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:09.017049 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1864d67-f58c-4335-9e3d-ad1db7207044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:09.017049 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1864d67-f58c-4335-9e3d-ad1db7207044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:09.017049 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1864d67-f58c-4335-9e3d-ad1db7207044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:09.017928 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1864d67-f58c-4335-9e3d-ad1db7207044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:09.018236 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 41/92] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:07 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:09.183155 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d1864d67-f58c-4335-9e3d-ad1db7207044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:09.193016 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d1864d67-f58c-4335-9e3d-ad1db7207044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.196939 Jul 21 23:39:09.194242 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 52/93] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:08 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:09.343668 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9120d066-ef3f-4c54-a275-dfb7a2247511 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:09.344310 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9120d066-ef3f-4c54-a275-dfb7a2247511 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:09.350917 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9120d066-ef3f-4c54-a275-dfb7a2247511 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:09.351412 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9120d066-ef3f-4c54-a275-dfb7a2247511 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:09.352121 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9120d066-ef3f-4c54-a275-dfb7a2247511 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:09.352719 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9120d066-ef3f-4c54-a275-dfb7a2247511 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:09.535224 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9120d066-ef3f-4c54-a275-dfb7a2247511 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:09.542988 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9120d066-ef3f-4c54-a275-dfb7a2247511 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.203872 Jul 21 23:39:09.544003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 42/94] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:09 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:09.733042 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-394049ec-c779-4243-a1c6-3f47939eeb6d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:09.734252 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-394049ec-c779-4243-a1c6-3f47939eeb6d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:09.740244 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-394049ec-c779-4243-a1c6-3f47939eeb6d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:09.740651 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-394049ec-c779-4243-a1c6-3f47939eeb6d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:09.741435 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-394049ec-c779-4243-a1c6-3f47939eeb6d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:09.741866 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-394049ec-c779-4243-a1c6-3f47939eeb6d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:09.881532 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-394049ec-c779-4243-a1c6-3f47939eeb6d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:09.890511 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-394049ec-c779-4243-a1c6-3f47939eeb6d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.161355 Jul 21 23:39:09.900251 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 53/95] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:09 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:10.025590 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b27e8eed-4b3f-44ac-bc14-6af37caabf00 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:10.026216 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b27e8eed-4b3f-44ac-bc14-6af37caabf00 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:10.032426 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b27e8eed-4b3f-44ac-bc14-6af37caabf00 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:10.032960 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b27e8eed-4b3f-44ac-bc14-6af37caabf00 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:10.033679 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b27e8eed-4b3f-44ac-bc14-6af37caabf00 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:10.034139 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b27e8eed-4b3f-44ac-bc14-6af37caabf00 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:10.167538 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b27e8eed-4b3f-44ac-bc14-6af37caabf00 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:10.176538 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b27e8eed-4b3f-44ac-bc14-6af37caabf00 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:10.178323 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b27e8eed-4b3f-44ac-bc14-6af37caabf00 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:10.179539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b27e8eed-4b3f-44ac-bc14-6af37caabf00 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.157786 Jul 21 23:39:10.180161 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 43/96] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:10 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:10.209878 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d1fe3bf2-e523-4061-8781-b743018336cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:10.210632 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d1fe3bf2-e523-4061-8781-b743018336cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:10.217591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1fe3bf2-e523-4061-8781-b743018336cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:10.218040 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1fe3bf2-e523-4061-8781-b743018336cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:10.218802 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1fe3bf2-e523-4061-8781-b743018336cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:10.219235 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1fe3bf2-e523-4061-8781-b743018336cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:10.384246 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d1fe3bf2-e523-4061-8781-b743018336cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:10.392559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d1fe3bf2-e523-4061-8781-b743018336cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.186441 Jul 21 23:39:10.393300 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 54/97] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:10 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:10.560805 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-28c5bbda-1aed-4c85-be15-385b98d0580f tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:10.561544 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-28c5bbda-1aed-4c85-be15-385b98d0580f tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:10.567718 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28c5bbda-1aed-4c85-be15-385b98d0580f tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:10.568291 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28c5bbda-1aed-4c85-be15-385b98d0580f tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:10.569105 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28c5bbda-1aed-4c85-be15-385b98d0580f tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:10.569637 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28c5bbda-1aed-4c85-be15-385b98d0580f tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:10.618333 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-b814910f-3c42-43f1-86cc-58383b5dbf13 req-7d283826-f094-4f0d-b1ba-056ce6ec2dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "050a4396-33a9-4f73-bfa6-7ed26142ef29", "tag": "01ed1fe2-aa7a-432f-bed5-f261e1ca3563"}, {"name": "network-changed", "server_uuid": "eb1e0d18-427a-456e-8ca0-c246e41f1fab", "tag": "7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:10.628331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b814910f-3c42-43f1-86cc-58383b5dbf13 req-7d283826-f094-4f0d-b1ba-056ce6ec2dc9 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:10.629066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b814910f-3c42-43f1-86cc-58383b5dbf13 req-7d283826-f094-4f0d-b1ba-056ce6ec2dc9 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:10.643006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-b814910f-3c42-43f1-86cc-58383b5dbf13 req-7d283826-f094-4f0d-b1ba-056ce6ec2dc9 service nova] Creating event network-changed:01ed1fe2-aa7a-432f-bed5-f261e1ca3563 for instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 on hv-cinder-85070 Jul 21 23:39:10.643611 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-b814910f-3c42-43f1-86cc-58383b5dbf13 req-7d283826-f094-4f0d-b1ba-056ce6ec2dc9 service nova] Creating event network-changed:7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8 for instance eb1e0d18-427a-456e-8ca0-c246e41f1fab on hv-cinder-85070 Jul 21 23:39:10.650239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-b814910f-3c42-43f1-86cc-58383b5dbf13 req-7d283826-f094-4f0d-b1ba-056ce6ec2dc9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035666 Jul 21 23:39:10.651237 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 55/98] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:39:10.911683 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1b3905ab-dab0-4ed3-93ad-ad1c9477d123 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:10.913243 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1b3905ab-dab0-4ed3-93ad-ad1c9477d123 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:10.921975 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b3905ab-dab0-4ed3-93ad-ad1c9477d123 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:10.922685 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b3905ab-dab0-4ed3-93ad-ad1c9477d123 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:10.924024 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b3905ab-dab0-4ed3-93ad-ad1c9477d123 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:10.924564 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b3905ab-dab0-4ed3-93ad-ad1c9477d123 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:10.953817 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-28c5bbda-1aed-4c85-be15-385b98d0580f tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:10.961833 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-28c5bbda-1aed-4c85-be15-385b98d0580f tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.405161 Jul 21 23:39:10.962945 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 44/99] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:10 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:11.072710 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1b3905ab-dab0-4ed3-93ad-ad1c9477d123 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:11.080397 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1b3905ab-dab0-4ed3-93ad-ad1c9477d123 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.174954 Jul 21 23:39:11.081161 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 56/100] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:10 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:11.197867 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6114da1a-4d85-47fd-969a-cdd0df29fd90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:11.198480 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6114da1a-4d85-47fd-969a-cdd0df29fd90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:11.205366 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6114da1a-4d85-47fd-969a-cdd0df29fd90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:11.205814 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6114da1a-4d85-47fd-969a-cdd0df29fd90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:11.206579 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6114da1a-4d85-47fd-969a-cdd0df29fd90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:11.207018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6114da1a-4d85-47fd-969a-cdd0df29fd90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:11.411081 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5112521e-982e-495b-aec8-0a6c3c5ea932 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:11.412089 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5112521e-982e-495b-aec8-0a6c3c5ea932 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:11.419367 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5112521e-982e-495b-aec8-0a6c3c5ea932 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:11.420752 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5112521e-982e-495b-aec8-0a6c3c5ea932 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:11.422345 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5112521e-982e-495b-aec8-0a6c3c5ea932 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:11.423456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5112521e-982e-495b-aec8-0a6c3c5ea932 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:11.461429 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6114da1a-4d85-47fd-969a-cdd0df29fd90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:11.478088 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6114da1a-4d85-47fd-969a-cdd0df29fd90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:11.484745 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6114da1a-4d85-47fd-969a-cdd0df29fd90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:11.485993 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6114da1a-4d85-47fd-969a-cdd0df29fd90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.292051 Jul 21 23:39:11.486577 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 45/101] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:11 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:11.682702 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5112521e-982e-495b-aec8-0a6c3c5ea932 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:11.690634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5112521e-982e-495b-aec8-0a6c3c5ea932 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.284698 Jul 21 23:39:11.691208 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 57/102] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:11 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:11.980270 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5825c05a-17fa-4b5a-b36e-d947232064ba tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:11.981479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5825c05a-17fa-4b5a-b36e-d947232064ba tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:11.989820 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5825c05a-17fa-4b5a-b36e-d947232064ba tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:11.991012 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5825c05a-17fa-4b5a-b36e-d947232064ba tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:11.991994 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5825c05a-17fa-4b5a-b36e-d947232064ba tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:11.992855 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5825c05a-17fa-4b5a-b36e-d947232064ba tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:12.096947 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-285e85d6-adf1-41f1-9bc7-d462b168ca33 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:12.097703 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-285e85d6-adf1-41f1-9bc7-d462b168ca33 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:12.104626 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-285e85d6-adf1-41f1-9bc7-d462b168ca33 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:12.114712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-285e85d6-adf1-41f1-9bc7-d462b168ca33 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:12.115788 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-285e85d6-adf1-41f1-9bc7-d462b168ca33 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:12.116443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-285e85d6-adf1-41f1-9bc7-d462b168ca33 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:12.464616 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-285e85d6-adf1-41f1-9bc7-d462b168ca33 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:12.477986 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-285e85d6-adf1-41f1-9bc7-d462b168ca33 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.384953 Jul 21 23:39:12.487528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5825c05a-17fa-4b5a-b36e-d947232064ba tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:12.493016 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 58/103] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:12 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:12.501374 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5825c05a-17fa-4b5a-b36e-d947232064ba tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.525627 Jul 21 23:39:12.501978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 46/104] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:11 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:12.516835 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-323a6ea7-4dcd-4e72-851b-f205e83d6a6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:12.517964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-323a6ea7-4dcd-4e72-851b-f205e83d6a6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:12.528942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-323a6ea7-4dcd-4e72-851b-f205e83d6a6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:12.530009 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-323a6ea7-4dcd-4e72-851b-f205e83d6a6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:12.530979 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-323a6ea7-4dcd-4e72-851b-f205e83d6a6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:12.531564 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-323a6ea7-4dcd-4e72-851b-f205e83d6a6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:12.711741 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6604fdae-05d9-4280-a6a0-ce774dfdb626 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:12.712207 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6604fdae-05d9-4280-a6a0-ce774dfdb626 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:12.745266 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6604fdae-05d9-4280-a6a0-ce774dfdb626 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:12.748650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6604fdae-05d9-4280-a6a0-ce774dfdb626 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:12.749823 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6604fdae-05d9-4280-a6a0-ce774dfdb626 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:12.751596 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6604fdae-05d9-4280-a6a0-ce774dfdb626 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:13.034047 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-323a6ea7-4dcd-4e72-851b-f205e83d6a6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:13.040553 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6604fdae-05d9-4280-a6a0-ce774dfdb626 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:13.051972 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6604fdae-05d9-4280-a6a0-ce774dfdb626 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.342910 Jul 21 23:39:13.051972 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 47/105] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:12 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:13.055601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-d6b00eed-3770-4683-a21e-dc71c6f4713d req-a455942d-c93d-4c52-ad4a-016e247a8f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4395db50-179b-4591-bec9-a738ad477d31", "tag": "b7d67a8b-6367-4be6-bd44-466169d1217b"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:13.070904 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-d6b00eed-3770-4683-a21e-dc71c6f4713d req-a455942d-c93d-4c52-ad4a-016e247a8f89 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:13.071644 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-d6b00eed-3770-4683-a21e-dc71c6f4713d req-a455942d-c93d-4c52-ad4a-016e247a8f89 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:13.074745 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-323a6ea7-4dcd-4e72-851b-f205e83d6a6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:13.077707 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-323a6ea7-4dcd-4e72-851b-f205e83d6a6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:13.079149 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-323a6ea7-4dcd-4e72-851b-f205e83d6a6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.578857 Jul 21 23:39:13.093171 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 59/106] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:12 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:13.105750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-d6b00eed-3770-4683-a21e-dc71c6f4713d req-a455942d-c93d-4c52-ad4a-016e247a8f89 service nova] Creating event network-changed:b7d67a8b-6367-4be6-bd44-466169d1217b for instance 4395db50-179b-4591-bec9-a738ad477d31 on hv-cinder-85070 Jul 21 23:39:13.112496 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-d6b00eed-3770-4683-a21e-dc71c6f4713d req-a455942d-c93d-4c52-ad4a-016e247a8f89 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124387) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 23:39:13.114172 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cc8ff143-8c36-4156-9d4b-039fd082c4aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:13.114780 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cc8ff143-8c36-4156-9d4b-039fd082c4aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:13.116325 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cc8ff143-8c36-4156-9d4b-039fd082c4aa None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:13.116918 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cc8ff143-8c36-4156-9d4b-039fd082c4aa None None] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:13.127075 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.compute.rpcapi [None req-cc8ff143-8c36-4156-9d4b-039fd082c4aa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 23:39:13.127968 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cc8ff143-8c36-4156-9d4b-039fd082c4aa None None] Releasing lock "compute-rpcapi-router" {{(pid=124387) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 23:39:13.156987 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-cc8ff143-8c36-4156-9d4b-039fd082c4aa None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104872 Jul 21 23:39:13.157793 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 48/107] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:39:13.498692 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e1d68d72-2c94-416e-8185-e359bc88c8b5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:13.499405 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e1d68d72-2c94-416e-8185-e359bc88c8b5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:13.506620 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1d68d72-2c94-416e-8185-e359bc88c8b5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:13.513291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1d68d72-2c94-416e-8185-e359bc88c8b5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:13.514784 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1d68d72-2c94-416e-8185-e359bc88c8b5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:13.515541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e1d68d72-2c94-416e-8185-e359bc88c8b5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:13.519364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-64c13d2e-5d33-4ce6-b63b-a06a12b557c6 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:13.520164 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-64c13d2e-5d33-4ce6-b63b-a06a12b557c6 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:13.530811 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-64c13d2e-5d33-4ce6-b63b-a06a12b557c6 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:13.532192 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-64c13d2e-5d33-4ce6-b63b-a06a12b557c6 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:13.536395 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-64c13d2e-5d33-4ce6-b63b-a06a12b557c6 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:13.541842 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-64c13d2e-5d33-4ce6-b63b-a06a12b557c6 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:13.717039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e1d68d72-2c94-416e-8185-e359bc88c8b5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:13.725466 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e1d68d72-2c94-416e-8185-e359bc88c8b5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.231253 Jul 21 23:39:13.726866 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-64c13d2e-5d33-4ce6-b63b-a06a12b557c6 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:13.734417 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 60/108] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:13 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:13.738020 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-64c13d2e-5d33-4ce6-b63b-a06a12b557c6 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.222898 Jul 21 23:39:13.738582 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 49/109] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:13 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:14.068130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7f191793-97f0-4deb-823c-7273036dabdb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:14.068817 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7f191793-97f0-4deb-823c-7273036dabdb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:14.075164 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f191793-97f0-4deb-823c-7273036dabdb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:14.075611 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f191793-97f0-4deb-823c-7273036dabdb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:14.076374 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f191793-97f0-4deb-823c-7273036dabdb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:14.076808 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f191793-97f0-4deb-823c-7273036dabdb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:14.099407 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2ece02a6-2ba7-41bd-8d58-0d17e19185dc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:14.100007 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2ece02a6-2ba7-41bd-8d58-0d17e19185dc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:14.108768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2ece02a6-2ba7-41bd-8d58-0d17e19185dc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:14.109403 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2ece02a6-2ba7-41bd-8d58-0d17e19185dc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:14.109999 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2ece02a6-2ba7-41bd-8d58-0d17e19185dc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:14.110436 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2ece02a6-2ba7-41bd-8d58-0d17e19185dc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:14.208130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7f191793-97f0-4deb-823c-7273036dabdb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:14.216444 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7f191793-97f0-4deb-823c-7273036dabdb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.152403 Jul 21 23:39:14.217020 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 61/110] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:14 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:14.251519 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2ece02a6-2ba7-41bd-8d58-0d17e19185dc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:14.259273 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2ece02a6-2ba7-41bd-8d58-0d17e19185dc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:14.260756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2ece02a6-2ba7-41bd-8d58-0d17e19185dc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:14.261876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2ece02a6-2ba7-41bd-8d58-0d17e19185dc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.166357 Jul 21 23:39:14.262523 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 50/111] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:14 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:39:14.742370 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-dabb0c1e-9b9a-4aee-8e77-d91963e1a03d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:14.742998 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-dabb0c1e-9b9a-4aee-8e77-d91963e1a03d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:14.749403 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dabb0c1e-9b9a-4aee-8e77-d91963e1a03d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:14.749789 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dabb0c1e-9b9a-4aee-8e77-d91963e1a03d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:14.750549 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dabb0c1e-9b9a-4aee-8e77-d91963e1a03d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:14.750979 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-dabb0c1e-9b9a-4aee-8e77-d91963e1a03d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:14.756194 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-aecf859a-239b-4928-89d2-600f93a16c63 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:14.756823 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-aecf859a-239b-4928-89d2-600f93a16c63 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:14.763177 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-aecf859a-239b-4928-89d2-600f93a16c63 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:14.763613 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-aecf859a-239b-4928-89d2-600f93a16c63 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:14.764364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-aecf859a-239b-4928-89d2-600f93a16c63 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:14.764787 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-aecf859a-239b-4928-89d2-600f93a16c63 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:14.881490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-dabb0c1e-9b9a-4aee-8e77-d91963e1a03d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:14.889692 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-dabb0c1e-9b9a-4aee-8e77-d91963e1a03d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.151159 Jul 21 23:39:14.890271 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 62/112] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:14 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:14.895692 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-aecf859a-239b-4928-89d2-600f93a16c63 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:14.903790 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-aecf859a-239b-4928-89d2-600f93a16c63 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.152351 Jul 21 23:39:14.904352 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 51/113] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:14 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:15.233445 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-28aa3979-d919-4675-a08f-75b33f93c49b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:15.234077 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-28aa3979-d919-4675-a08f-75b33f93c49b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:15.236002 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:15.241315 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-28aa3979-d919-4675-a08f-75b33f93c49b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:15.241756 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-28aa3979-d919-4675-a08f-75b33f93c49b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:15.242527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-28aa3979-d919-4675-a08f-75b33f93c49b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:15.242954 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-28aa3979-d919-4675-a08f-75b33f93c49b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:15.294272 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-096ffa7c-79f2-4665-b659-3f54bd9a4793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:15.297764 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-096ffa7c-79f2-4665-b659-3f54bd9a4793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:15.306536 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-096ffa7c-79f2-4665-b659-3f54bd9a4793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:15.308013 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-096ffa7c-79f2-4665-b659-3f54bd9a4793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:15.309067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-096ffa7c-79f2-4665-b659-3f54bd9a4793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:15.309806 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-096ffa7c-79f2-4665-b659-3f54bd9a4793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:15.471678 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-096ffa7c-79f2-4665-b659-3f54bd9a4793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:15.483324 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-096ffa7c-79f2-4665-b659-3f54bd9a4793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:15.484961 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-096ffa7c-79f2-4665-b659-3f54bd9a4793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:15.486206 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-096ffa7c-79f2-4665-b659-3f54bd9a4793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.208813 Jul 21 23:39:15.497679 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 52/114] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:15 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:15.544245 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-28aa3979-d919-4675-a08f-75b33f93c49b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:15.552009 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-28aa3979-d919-4675-a08f-75b33f93c49b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.323062 Jul 21 23:39:15.552663 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 63/115] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:15 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:15.906057 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5298b07a-6109-44b6-8be7-8a616e632624 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:15.906664 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5298b07a-6109-44b6-8be7-8a616e632624 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:15.912895 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5298b07a-6109-44b6-8be7-8a616e632624 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:15.913374 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5298b07a-6109-44b6-8be7-8a616e632624 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:15.915485 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5298b07a-6109-44b6-8be7-8a616e632624 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:15.915485 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5298b07a-6109-44b6-8be7-8a616e632624 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:15.921504 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-be982649-03e9-46cd-8c24-fc461abae3b4 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:15.922120 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-be982649-03e9-46cd-8c24-fc461abae3b4 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:15.928669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be982649-03e9-46cd-8c24-fc461abae3b4 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:15.929121 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be982649-03e9-46cd-8c24-fc461abae3b4 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:15.929929 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be982649-03e9-46cd-8c24-fc461abae3b4 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:15.930361 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be982649-03e9-46cd-8c24-fc461abae3b4 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:16.276512 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-be982649-03e9-46cd-8c24-fc461abae3b4 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:16.279567 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:16.291006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-be982649-03e9-46cd-8c24-fc461abae3b4 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.374270 Jul 21 23:39:16.305425 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 64/116] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:15 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:16.377323 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5298b07a-6109-44b6-8be7-8a616e632624 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:16.391482 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5298b07a-6109-44b6-8be7-8a616e632624 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.490008 Jul 21 23:39:16.407208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 53/117] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:15 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:16.504877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-36591b2d-d9d4-4691-8560-71f7da64dba8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:16.505538 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-36591b2d-d9d4-4691-8560-71f7da64dba8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:16.515155 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36591b2d-d9d4-4691-8560-71f7da64dba8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:16.515613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36591b2d-d9d4-4691-8560-71f7da64dba8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:16.516385 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36591b2d-d9d4-4691-8560-71f7da64dba8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:16.516824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36591b2d-d9d4-4691-8560-71f7da64dba8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:16.569929 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d3daf8c9-098d-478b-8be1-4076b7a6f1c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:16.571251 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d3daf8c9-098d-478b-8be1-4076b7a6f1c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:16.580433 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3daf8c9-098d-478b-8be1-4076b7a6f1c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:16.581143 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3daf8c9-098d-478b-8be1-4076b7a6f1c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:16.582331 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3daf8c9-098d-478b-8be1-4076b7a6f1c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:16.583295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3daf8c9-098d-478b-8be1-4076b7a6f1c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:16.971766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-36591b2d-d9d4-4691-8560-71f7da64dba8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:16.994535 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-36591b2d-d9d4-4691-8560-71f7da64dba8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:16.996679 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-36591b2d-d9d4-4691-8560-71f7da64dba8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:16.998508 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-36591b2d-d9d4-4691-8560-71f7da64dba8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.497720 Jul 21 23:39:17.012063 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 65/118] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:16 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:17.078686 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d3daf8c9-098d-478b-8be1-4076b7a6f1c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:17.086916 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d3daf8c9-098d-478b-8be1-4076b7a6f1c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.521335 Jul 21 23:39:17.096784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 54/119] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:16 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:17.310928 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5a23c83b-7fc9-4fcc-84b5-4f8cd73d1a91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:17.311561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5a23c83b-7fc9-4fcc-84b5-4f8cd73d1a91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:17.317756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a23c83b-7fc9-4fcc-84b5-4f8cd73d1a91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:17.318206 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a23c83b-7fc9-4fcc-84b5-4f8cd73d1a91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:17.318959 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a23c83b-7fc9-4fcc-84b5-4f8cd73d1a91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:17.319657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a23c83b-7fc9-4fcc-84b5-4f8cd73d1a91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:17.343360 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-4dacae1f-4a54-4358-820c-4e0585128950 req-93f7d6c1-e7f7-4b43-9191-6a5647d4107e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16c660c-f977-46c1-9b2a-c85d81c8368d", "name": "network-vif-plugged", "status": "completed", "tag": "e5354cca-d4b3-4289-aaf0-fb839e6ccac2"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:17.370506 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4dacae1f-4a54-4358-820c-4e0585128950 req-93f7d6c1-e7f7-4b43-9191-6a5647d4107e service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:17.378427 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4dacae1f-4a54-4358-820c-4e0585128950 req-93f7d6c1-e7f7-4b43-9191-6a5647d4107e service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:17.391592 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-4dacae1f-4a54-4358-820c-4e0585128950 req-93f7d6c1-e7f7-4b43-9191-6a5647d4107e service nova] Creating event network-vif-plugged:e5354cca-d4b3-4289-aaf0-fb839e6ccac2 for instance c16c660c-f977-46c1-9b2a-c85d81c8368d on hv-cinder-85070 Jul 21 23:39:17.397057 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-4dacae1f-4a54-4358-820c-4e0585128950 req-93f7d6c1-e7f7-4b43-9191-6a5647d4107e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112589 Jul 21 23:39:17.398328 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 66/120] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:39:17.410945 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2612ac6f-6ce6-4464-811a-e3ff2dc73a3b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:17.411982 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2612ac6f-6ce6-4464-811a-e3ff2dc73a3b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:17.419589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2612ac6f-6ce6-4464-811a-e3ff2dc73a3b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:17.420156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2612ac6f-6ce6-4464-811a-e3ff2dc73a3b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:17.421177 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2612ac6f-6ce6-4464-811a-e3ff2dc73a3b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:17.421717 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2612ac6f-6ce6-4464-811a-e3ff2dc73a3b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:17.587993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2612ac6f-6ce6-4464-811a-e3ff2dc73a3b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:17.597085 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2612ac6f-6ce6-4464-811a-e3ff2dc73a3b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.192079 Jul 21 23:39:17.609117 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 67/121] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:17 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:17.928753 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5a23c83b-7fc9-4fcc-84b5-4f8cd73d1a91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:17.940349 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5a23c83b-7fc9-4fcc-84b5-4f8cd73d1a91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.632362 Jul 21 23:39:17.951859 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 55/122] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:17 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:18.021002 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6484f9d1-2338-4155-9965-5de6c715325e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:18.023146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6484f9d1-2338-4155-9965-5de6c715325e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:18.032742 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6484f9d1-2338-4155-9965-5de6c715325e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:18.033515 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6484f9d1-2338-4155-9965-5de6c715325e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:18.034588 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6484f9d1-2338-4155-9965-5de6c715325e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:18.035132 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6484f9d1-2338-4155-9965-5de6c715325e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:18.103681 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bd077b95-f2c4-4162-a056-c8d64ef97670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:18.104284 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bd077b95-f2c4-4162-a056-c8d64ef97670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:18.119501 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd077b95-f2c4-4162-a056-c8d64ef97670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:18.119960 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd077b95-f2c4-4162-a056-c8d64ef97670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:18.120945 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd077b95-f2c4-4162-a056-c8d64ef97670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:18.121756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd077b95-f2c4-4162-a056-c8d64ef97670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:18.256797 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6484f9d1-2338-4155-9965-5de6c715325e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:18.271982 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6484f9d1-2338-4155-9965-5de6c715325e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:18.276654 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bd077b95-f2c4-4162-a056-c8d64ef97670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:18.281426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6484f9d1-2338-4155-9965-5de6c715325e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:18.282605 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6484f9d1-2338-4155-9965-5de6c715325e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.268040 Jul 21 23:39:18.299314 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bd077b95-f2c4-4162-a056-c8d64ef97670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.199320 Jul 21 23:39:18.300290 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 56/123] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:18 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:18.300363 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 68/124] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:18 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:39:18.614998 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a5559892-433d-41bf-8817-aa5e4a549f46 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:18.615612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-a5559892-433d-41bf-8817-aa5e4a549f46 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:18.622967 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a5559892-433d-41bf-8817-aa5e4a549f46 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:18.623688 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a5559892-433d-41bf-8817-aa5e4a549f46 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:18.624439 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a5559892-433d-41bf-8817-aa5e4a549f46 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:18.624876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a5559892-433d-41bf-8817-aa5e4a549f46 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:18.951636 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a5559892-433d-41bf-8817-aa5e4a549f46 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:18.957947 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-26af896b-5f59-4d28-a479-4f20261a6aea tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:18.958342 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-26af896b-5f59-4d28-a479-4f20261a6aea tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:18.960278 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a5559892-433d-41bf-8817-aa5e4a549f46 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.349239 Jul 21 23:39:18.960852 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 57/125] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:18 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:18.968987 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26af896b-5f59-4d28-a479-4f20261a6aea tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:18.971986 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26af896b-5f59-4d28-a479-4f20261a6aea tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:18.972973 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26af896b-5f59-4d28-a479-4f20261a6aea tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:18.973958 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26af896b-5f59-4d28-a479-4f20261a6aea tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:19.239020 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-26af896b-5f59-4d28-a479-4f20261a6aea tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:19.255663 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-26af896b-5f59-4d28-a479-4f20261a6aea tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.301862 Jul 21 23:39:19.258156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 69/126] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:18 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:19.305544 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2981665d-d53b-4312-92fd-6f449c6c26b3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:19.306144 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2981665d-d53b-4312-92fd-6f449c6c26b3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:19.317953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f25b277f-662d-454b-a5f6-3235ee631d5c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:19.318694 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f25b277f-662d-454b-a5f6-3235ee631d5c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:19.331617 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f25b277f-662d-454b-a5f6-3235ee631d5c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:19.333051 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f25b277f-662d-454b-a5f6-3235ee631d5c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:19.335543 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f25b277f-662d-454b-a5f6-3235ee631d5c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:19.336535 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f25b277f-662d-454b-a5f6-3235ee631d5c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:19.337075 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2981665d-d53b-4312-92fd-6f449c6c26b3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:19.338099 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2981665d-d53b-4312-92fd-6f449c6c26b3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:19.341029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2981665d-d53b-4312-92fd-6f449c6c26b3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:19.342571 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2981665d-d53b-4312-92fd-6f449c6c26b3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:19.380212 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=100 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:19.614038 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2981665d-d53b-4312-92fd-6f449c6c26b3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:19.633823 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2981665d-d53b-4312-92fd-6f449c6c26b3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:19.635939 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2981665d-d53b-4312-92fd-6f449c6c26b3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:19.638064 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2981665d-d53b-4312-92fd-6f449c6c26b3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.337396 Jul 21 23:39:19.639844 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f25b277f-662d-454b-a5f6-3235ee631d5c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:19.649985 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 58/127] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:19 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:19.653959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f25b277f-662d-454b-a5f6-3235ee631d5c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1322 microversion: 2.1 time: 0.341307 Jul 21 23:39:19.655700 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 70/128] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:19 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:19.979756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ea56a799-6d6b-4cca-826d-52d5382e3467 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:19.981067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ea56a799-6d6b-4cca-826d-52d5382e3467 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:20.005312 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ea56a799-6d6b-4cca-826d-52d5382e3467 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:20.007372 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ea56a799-6d6b-4cca-826d-52d5382e3467 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:20.008266 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ea56a799-6d6b-4cca-826d-52d5382e3467 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:20.008720 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ea56a799-6d6b-4cca-826d-52d5382e3467 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:20.216709 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ea56a799-6d6b-4cca-826d-52d5382e3467 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:20.226039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ea56a799-6d6b-4cca-826d-52d5382e3467 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.252130 Jul 21 23:39:20.226903 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 59/129] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:19 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:20.277434 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5e18413a-816f-4aa5-b7ed-568989ae2e60 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:20.278305 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5e18413a-816f-4aa5-b7ed-568989ae2e60 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:20.288057 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5e18413a-816f-4aa5-b7ed-568989ae2e60 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:20.289706 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5e18413a-816f-4aa5-b7ed-568989ae2e60 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:20.290561 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5e18413a-816f-4aa5-b7ed-568989ae2e60 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:20.291438 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5e18413a-816f-4aa5-b7ed-568989ae2e60 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:20.493334 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5e18413a-816f-4aa5-b7ed-568989ae2e60 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:20.503260 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5e18413a-816f-4aa5-b7ed-568989ae2e60 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.229924 Jul 21 23:39:20.504215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 71/130] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:20 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:20.665119 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5d71f1df-c25d-4479-9b5f-725a54807ad2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:20.672335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ee66b0f6-dda5-4f74-8214-89987c762b2e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:20.673484 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5d71f1df-c25d-4479-9b5f-725a54807ad2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:20.676405 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ee66b0f6-dda5-4f74-8214-89987c762b2e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:20.702696 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee66b0f6-dda5-4f74-8214-89987c762b2e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:20.704443 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5d71f1df-c25d-4479-9b5f-725a54807ad2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:20.706327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5d71f1df-c25d-4479-9b5f-725a54807ad2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:20.707991 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee66b0f6-dda5-4f74-8214-89987c762b2e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:20.708837 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee66b0f6-dda5-4f74-8214-89987c762b2e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:20.709275 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee66b0f6-dda5-4f74-8214-89987c762b2e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:20.710709 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5d71f1df-c25d-4479-9b5f-725a54807ad2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:20.711669 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5d71f1df-c25d-4479-9b5f-725a54807ad2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:20.987112 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ee66b0f6-dda5-4f74-8214-89987c762b2e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:20.999484 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ee66b0f6-dda5-4f74-8214-89987c762b2e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1517 microversion: 2.1 time: 0.331432 Jul 21 23:39:21.000889 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 72/131] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:20 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1517 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:21.021445 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8b8f1734-21ed-4dbf-9602-11be6b657697 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:21.022772 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8b8f1734-21ed-4dbf-9602-11be6b657697 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:21.037596 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b8f1734-21ed-4dbf-9602-11be6b657697 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:21.038650 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b8f1734-21ed-4dbf-9602-11be6b657697 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:21.041015 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b8f1734-21ed-4dbf-9602-11be6b657697 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:21.041823 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b8f1734-21ed-4dbf-9602-11be6b657697 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:21.237156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-8b8f1734-21ed-4dbf-9602-11be6b657697 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lazy-loading 'flavor' on Instance uuid c16c660c-f977-46c1-9b2a-c85d81c8368d {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:39:21.325023 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5d71f1df-c25d-4479-9b5f-725a54807ad2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:21.335355 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5d71f1df-c25d-4479-9b5f-725a54807ad2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:21.340415 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5d71f1df-c25d-4479-9b5f-725a54807ad2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:21.346590 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5d71f1df-c25d-4479-9b5f-725a54807ad2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.694719 Jul 21 23:39:21.347174 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 60/132] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:20 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:39:21.363899 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8bb76a49-4f3a-4bcd-9a3d-808c6ff53bae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:21.364502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8bb76a49-4f3a-4bcd-9a3d-808c6ff53bae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:21.386135 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8bb76a49-4f3a-4bcd-9a3d-808c6ff53bae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:21.386719 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8bb76a49-4f3a-4bcd-9a3d-808c6ff53bae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:21.387494 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8bb76a49-4f3a-4bcd-9a3d-808c6ff53bae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:21.387944 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8bb76a49-4f3a-4bcd-9a3d-808c6ff53bae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:21.551502 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8b8f1734-21ed-4dbf-9602-11be6b657697 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "POST /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d/action" status: 200 len: 32 microversion: 2.1 time: 0.536450 Jul 21 23:39:21.552289 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 73/133] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:39:21 2022] POST /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d/action => generated 32 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:39:21.572949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a735e5e0-8425-4561-a43b-73886c18ba50 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:21.574241 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a735e5e0-8425-4561-a43b-73886c18ba50 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:21.601004 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a735e5e0-8425-4561-a43b-73886c18ba50 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:21.601421 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a735e5e0-8425-4561-a43b-73886c18ba50 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:21.602418 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a735e5e0-8425-4561-a43b-73886c18ba50 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:21.603066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a735e5e0-8425-4561-a43b-73886c18ba50 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:21.726560 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-8bb76a49-4f3a-4bcd-9a3d-808c6ff53bae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:21.736998 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8bb76a49-4f3a-4bcd-9a3d-808c6ff53bae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.378193 Jul 21 23:39:21.740187 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 61/134] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:21 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:21.749234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-dee337a5-cf4b-4017-b8ae-e13d15140810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:21.750609 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-dee337a5-cf4b-4017-b8ae-e13d15140810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:21.768551 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dee337a5-cf4b-4017-b8ae-e13d15140810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:21.770855 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dee337a5-cf4b-4017-b8ae-e13d15140810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:21.773701 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dee337a5-cf4b-4017-b8ae-e13d15140810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:21.776483 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dee337a5-cf4b-4017-b8ae-e13d15140810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:21.840289 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a735e5e0-8425-4561-a43b-73886c18ba50 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:21.854582 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a735e5e0-8425-4561-a43b-73886c18ba50 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.299197 Jul 21 23:39:21.857396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 74/135] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:21 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:21.951978 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-0bac89f7-8804-49b3-b0ca-a8cc5756a0bf req-4761aa1d-20dc-4e85-adc9-a98819ceadc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af6350f-5066-435f-bf01-5541dd1d3b18", "name": "network-vif-plugged", "status": "completed", "tag": "365fc751-fe38-4f1c-aa15-d43a2299f5d0"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:21.975684 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-0bac89f7-8804-49b3-b0ca-a8cc5756a0bf req-4761aa1d-20dc-4e85-adc9-a98819ceadc4 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:21.976186 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-0bac89f7-8804-49b3-b0ca-a8cc5756a0bf req-4761aa1d-20dc-4e85-adc9-a98819ceadc4 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:22.009767 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-0bac89f7-8804-49b3-b0ca-a8cc5756a0bf req-4761aa1d-20dc-4e85-adc9-a98819ceadc4 service nova] Creating event network-vif-plugged:365fc751-fe38-4f1c-aa15-d43a2299f5d0 for instance 7af6350f-5066-435f-bf01-5541dd1d3b18 on hv-cinder-85070 Jul 21 23:39:22.015743 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-0bac89f7-8804-49b3-b0ca-a8cc5756a0bf req-4761aa1d-20dc-4e85-adc9-a98819ceadc4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068590 Jul 21 23:39:22.017238 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 75/136] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:39:22.035914 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-dee337a5-cf4b-4017-b8ae-e13d15140810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:22.045759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-dee337a5-cf4b-4017-b8ae-e13d15140810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.302112 Jul 21 23:39:22.046451 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 62/137] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:21 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:22.371309 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-051b701b-61f1-4886-82f9-66ef32c0abea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:22.371309 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-051b701b-61f1-4886-82f9-66ef32c0abea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:22.379370 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-051b701b-61f1-4886-82f9-66ef32c0abea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:22.381392 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-051b701b-61f1-4886-82f9-66ef32c0abea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:22.381392 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-051b701b-61f1-4886-82f9-66ef32c0abea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:22.381392 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-051b701b-61f1-4886-82f9-66ef32c0abea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:22.584484 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-051b701b-61f1-4886-82f9-66ef32c0abea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:22.594695 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-051b701b-61f1-4886-82f9-66ef32c0abea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:22.596718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-051b701b-61f1-4886-82f9-66ef32c0abea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:22.597986 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-051b701b-61f1-4886-82f9-66ef32c0abea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.235830 Jul 21 23:39:22.598536 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 76/138] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:22 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:22.757104 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d0ece056-1a31-408f-bca7-5881a52634f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:22.757769 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d0ece056-1a31-408f-bca7-5881a52634f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:22.764489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0ece056-1a31-408f-bca7-5881a52634f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:22.764941 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0ece056-1a31-408f-bca7-5881a52634f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:22.765706 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0ece056-1a31-408f-bca7-5881a52634f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:22.766251 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0ece056-1a31-408f-bca7-5881a52634f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:22.874351 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0ced2a38-1334-4079-98e9-d8ebe1da98cc tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:22.875116 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0ced2a38-1334-4079-98e9-d8ebe1da98cc tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:22.881627 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0ced2a38-1334-4079-98e9-d8ebe1da98cc tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:22.882070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0ced2a38-1334-4079-98e9-d8ebe1da98cc tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:22.882924 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0ced2a38-1334-4079-98e9-d8ebe1da98cc tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:22.883279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0ced2a38-1334-4079-98e9-d8ebe1da98cc tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:22.926974 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d0ece056-1a31-408f-bca7-5881a52634f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:22.934724 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d0ece056-1a31-408f-bca7-5881a52634f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.181390 Jul 21 23:39:22.943729 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 63/139] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:22 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:23.038288 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0ced2a38-1334-4079-98e9-d8ebe1da98cc tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:23.045747 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0ced2a38-1334-4079-98e9-d8ebe1da98cc tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.176988 Jul 21 23:39:23.046312 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 77/140] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:22 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:23.062681 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-543fd62d-704b-4024-a867-64ebaf4e9dc5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:23.063370 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-543fd62d-704b-4024-a867-64ebaf4e9dc5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:23.069249 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-543fd62d-704b-4024-a867-64ebaf4e9dc5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:23.069771 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-543fd62d-704b-4024-a867-64ebaf4e9dc5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:23.070525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-543fd62d-704b-4024-a867-64ebaf4e9dc5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:23.070972 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-543fd62d-704b-4024-a867-64ebaf4e9dc5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:23.125165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:23.210123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-543fd62d-704b-4024-a867-64ebaf4e9dc5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:23.218339 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-543fd62d-704b-4024-a867-64ebaf4e9dc5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.159469 Jul 21 23:39:23.218899 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 64/141] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:23 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:23.616857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bac1164a-3e84-4e34-8446-08ef1df6200b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:23.619343 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bac1164a-3e84-4e34-8446-08ef1df6200b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:23.624162 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bac1164a-3e84-4e34-8446-08ef1df6200b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:23.624693 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bac1164a-3e84-4e34-8446-08ef1df6200b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:23.625593 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bac1164a-3e84-4e34-8446-08ef1df6200b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:23.626117 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bac1164a-3e84-4e34-8446-08ef1df6200b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:23.768065 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bac1164a-3e84-4e34-8446-08ef1df6200b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:23.776303 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bac1164a-3e84-4e34-8446-08ef1df6200b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:23.777878 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bac1164a-3e84-4e34-8446-08ef1df6200b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:23.778975 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bac1164a-3e84-4e34-8446-08ef1df6200b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.166266 Jul 21 23:39:23.779540 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 78/142] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:23 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:23.951226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d2de2666-cfd8-4c29-9030-1d250636ef80 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:23.951954 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d2de2666-cfd8-4c29-9030-1d250636ef80 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:23.958167 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d2de2666-cfd8-4c29-9030-1d250636ef80 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:23.958695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d2de2666-cfd8-4c29-9030-1d250636ef80 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:23.959533 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d2de2666-cfd8-4c29-9030-1d250636ef80 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:23.960047 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d2de2666-cfd8-4c29-9030-1d250636ef80 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:24.058741 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-6992a7df-306f-4789-abf9-ce4fac5a8db9 req-2437e1ec-cabf-4a54-ae06-d23042715359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1e0d18-427a-456e-8ca0-c246e41f1fab", "name": "network-vif-plugged", "status": "completed", "tag": "7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:24.066759 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-6992a7df-306f-4789-abf9-ce4fac5a8db9 req-2437e1ec-cabf-4a54-ae06-d23042715359 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:24.067332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-6992a7df-306f-4789-abf9-ce4fac5a8db9 req-2437e1ec-cabf-4a54-ae06-d23042715359 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:24.078997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-6992a7df-306f-4789-abf9-ce4fac5a8db9 req-2437e1ec-cabf-4a54-ae06-d23042715359 service nova] Creating event network-vif-plugged:7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8 for instance eb1e0d18-427a-456e-8ca0-c246e41f1fab on hv-cinder-85070 Jul 21 23:39:24.083754 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-6992a7df-306f-4789-abf9-ce4fac5a8db9 req-2437e1ec-cabf-4a54-ae06-d23042715359 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029735 Jul 21 23:39:24.084352 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 79/143] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:39:24.089868 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2c0756fb-fdfb-44cb-a676-8d7ef3420b91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:24.090568 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2c0756fb-fdfb-44cb-a676-8d7ef3420b91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:24.096847 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2c0756fb-fdfb-44cb-a676-8d7ef3420b91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:24.097456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2c0756fb-fdfb-44cb-a676-8d7ef3420b91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:24.098223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2c0756fb-fdfb-44cb-a676-8d7ef3420b91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:24.098658 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2c0756fb-fdfb-44cb-a676-8d7ef3420b91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:24.161679 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d2de2666-cfd8-4c29-9030-1d250636ef80 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:24.169845 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d2de2666-cfd8-4c29-9030-1d250636ef80 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.222600 Jul 21 23:39:24.170404 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 65/144] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:23 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:24.236624 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-10e503b3-2ca8-46ff-bd1e-f7020b5952b1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:24.237247 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-10e503b3-2ca8-46ff-bd1e-f7020b5952b1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:24.243074 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-10e503b3-2ca8-46ff-bd1e-f7020b5952b1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:24.243515 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-10e503b3-2ca8-46ff-bd1e-f7020b5952b1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:24.244268 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-10e503b3-2ca8-46ff-bd1e-f7020b5952b1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:24.244694 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-10e503b3-2ca8-46ff-bd1e-f7020b5952b1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:24.293894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2c0756fb-fdfb-44cb-a676-8d7ef3420b91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:24.301162 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2c0756fb-fdfb-44cb-a676-8d7ef3420b91 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.215715 Jul 21 23:39:24.301747 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 80/145] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:24 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:24.387882 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-10e503b3-2ca8-46ff-bd1e-f7020b5952b1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:24.395458 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-10e503b3-2ca8-46ff-bd1e-f7020b5952b1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.162582 Jul 21 23:39:24.396027 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 66/146] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:24 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:24.797723 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1f563068-1f3d-446e-9e74-8306a26211aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:24.798952 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1f563068-1f3d-446e-9e74-8306a26211aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:24.805075 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f563068-1f3d-446e-9e74-8306a26211aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:24.805577 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f563068-1f3d-446e-9e74-8306a26211aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:24.806575 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f563068-1f3d-446e-9e74-8306a26211aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:24.807015 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f563068-1f3d-446e-9e74-8306a26211aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:24.823374 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:24.950312 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1f563068-1f3d-446e-9e74-8306a26211aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:24.958179 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1f563068-1f3d-446e-9e74-8306a26211aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:24.959681 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1f563068-1f3d-446e-9e74-8306a26211aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:24.960784 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1f563068-1f3d-446e-9e74-8306a26211aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.167603 Jul 21 23:39:24.961358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 81/147] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:24 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:25.187441 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d0b42b9a-b669-453c-a21e-43218122a690 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:25.188086 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d0b42b9a-b669-453c-a21e-43218122a690 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:25.194169 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0b42b9a-b669-453c-a21e-43218122a690 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:25.194611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0b42b9a-b669-453c-a21e-43218122a690 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:25.195363 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0b42b9a-b669-453c-a21e-43218122a690 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:25.195788 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0b42b9a-b669-453c-a21e-43218122a690 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:25.319867 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-53615fbf-f67d-433c-80de-bcb75941ec4c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:25.320821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-53615fbf-f67d-433c-80de-bcb75941ec4c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:25.329482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53615fbf-f67d-433c-80de-bcb75941ec4c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:25.330300 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53615fbf-f67d-433c-80de-bcb75941ec4c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:25.331319 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53615fbf-f67d-433c-80de-bcb75941ec4c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:25.331579 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d0b42b9a-b669-453c-a21e-43218122a690 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:25.331871 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53615fbf-f67d-433c-80de-bcb75941ec4c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:25.343497 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d0b42b9a-b669-453c-a21e-43218122a690 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.159991 Jul 21 23:39:25.344390 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 67/148] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:25 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:25.412942 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ccb0d5ea-c155-4016-b6a5-c2ad0588de9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:25.413647 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ccb0d5ea-c155-4016-b6a5-c2ad0588de9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:25.420007 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ccb0d5ea-c155-4016-b6a5-c2ad0588de9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:25.420528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ccb0d5ea-c155-4016-b6a5-c2ad0588de9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:25.421432 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ccb0d5ea-c155-4016-b6a5-c2ad0588de9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:25.421930 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ccb0d5ea-c155-4016-b6a5-c2ad0588de9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:25.475100 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-53615fbf-f67d-433c-80de-bcb75941ec4c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:25.483353 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-53615fbf-f67d-433c-80de-bcb75941ec4c tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.168790 Jul 21 23:39:25.484634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 82/149] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:25 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:25.564252 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ccb0d5ea-c155-4016-b6a5-c2ad0588de9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:25.572108 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ccb0d5ea-c155-4016-b6a5-c2ad0588de9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.163774 Jul 21 23:39:25.578155 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 68/150] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:25 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:25.979938 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-249bbaa7-f852-4b2e-9ea5-eb4b3f082c6e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:25.980591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-249bbaa7-f852-4b2e-9ea5-eb4b3f082c6e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:25.986619 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-249bbaa7-f852-4b2e-9ea5-eb4b3f082c6e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:25.987060 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-249bbaa7-f852-4b2e-9ea5-eb4b3f082c6e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:25.987816 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-249bbaa7-f852-4b2e-9ea5-eb4b3f082c6e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:25.988256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-249bbaa7-f852-4b2e-9ea5-eb4b3f082c6e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:26.133038 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-249bbaa7-f852-4b2e-9ea5-eb4b3f082c6e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:26.142254 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-249bbaa7-f852-4b2e-9ea5-eb4b3f082c6e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:26.143769 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-249bbaa7-f852-4b2e-9ea5-eb4b3f082c6e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:26.144878 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-249bbaa7-f852-4b2e-9ea5-eb4b3f082c6e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.168923 Jul 21 23:39:26.145469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 83/151] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:25 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:26.360425 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b6b2aa26-a00b-4f18-a239-ac378a0ac6f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:26.361162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b6b2aa26-a00b-4f18-a239-ac378a0ac6f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:26.367888 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6b2aa26-a00b-4f18-a239-ac378a0ac6f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:26.368327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6b2aa26-a00b-4f18-a239-ac378a0ac6f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:26.369077 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6b2aa26-a00b-4f18-a239-ac378a0ac6f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:26.369555 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6b2aa26-a00b-4f18-a239-ac378a0ac6f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:26.500738 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-57c0b3c9-dfc2-47b2-9ef1-d58f399f4050 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:26.501568 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-57c0b3c9-dfc2-47b2-9ef1-d58f399f4050 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:26.506437 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b6b2aa26-a00b-4f18-a239-ac378a0ac6f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:26.508810 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57c0b3c9-dfc2-47b2-9ef1-d58f399f4050 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:26.509375 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57c0b3c9-dfc2-47b2-9ef1-d58f399f4050 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:26.510299 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57c0b3c9-dfc2-47b2-9ef1-d58f399f4050 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:26.510890 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57c0b3c9-dfc2-47b2-9ef1-d58f399f4050 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:26.516343 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b6b2aa26-a00b-4f18-a239-ac378a0ac6f9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.159743 Jul 21 23:39:26.517168 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 69/152] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:26 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:26.591068 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b6c79775-8751-425e-aa59-51df539f4329 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:26.591804 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b6c79775-8751-425e-aa59-51df539f4329 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:26.597858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6c79775-8751-425e-aa59-51df539f4329 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:26.598399 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6c79775-8751-425e-aa59-51df539f4329 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:26.599391 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6c79775-8751-425e-aa59-51df539f4329 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:26.600030 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6c79775-8751-425e-aa59-51df539f4329 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:26.675771 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-57c0b3c9-dfc2-47b2-9ef1-d58f399f4050 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:26.684304 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-57c0b3c9-dfc2-47b2-9ef1-d58f399f4050 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.187647 Jul 21 23:39:26.685061 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 84/153] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:26 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:26.736266 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b6c79775-8751-425e-aa59-51df539f4329 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:26.743755 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b6c79775-8751-425e-aa59-51df539f4329 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.158171 Jul 21 23:39:26.744319 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 70/154] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:26 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:27.165459 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ea59fade-fb7f-4a36-9df6-9cf2afb43bea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:27.166071 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ea59fade-fb7f-4a36-9df6-9cf2afb43bea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:27.173492 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ea59fade-fb7f-4a36-9df6-9cf2afb43bea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:27.173943 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ea59fade-fb7f-4a36-9df6-9cf2afb43bea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:27.174950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ea59fade-fb7f-4a36-9df6-9cf2afb43bea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:27.175339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ea59fade-fb7f-4a36-9df6-9cf2afb43bea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:27.312698 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ea59fade-fb7f-4a36-9df6-9cf2afb43bea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:27.320800 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ea59fade-fb7f-4a36-9df6-9cf2afb43bea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:27.322478 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ea59fade-fb7f-4a36-9df6-9cf2afb43bea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:27.324398 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ea59fade-fb7f-4a36-9df6-9cf2afb43bea tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.163721 Jul 21 23:39:27.324958 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 85/155] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:27 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:27.533261 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2dcb0350-2539-4468-a8dd-d9ec079b36b1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:27.534609 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2dcb0350-2539-4468-a8dd-d9ec079b36b1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:27.541115 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2dcb0350-2539-4468-a8dd-d9ec079b36b1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:27.541594 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2dcb0350-2539-4468-a8dd-d9ec079b36b1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:27.543288 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2dcb0350-2539-4468-a8dd-d9ec079b36b1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:27.543876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2dcb0350-2539-4468-a8dd-d9ec079b36b1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:27.694403 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2dcb0350-2539-4468-a8dd-d9ec079b36b1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:27.702892 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2dcb0350-2539-4468-a8dd-d9ec079b36b1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.173445 Jul 21 23:39:27.703075 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c817842f-8305-4871-b024-9faad9b24075 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:27.703822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c817842f-8305-4871-b024-9faad9b24075 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:27.704426 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 71/156] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:27 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:27.712573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c817842f-8305-4871-b024-9faad9b24075 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:27.714600 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c817842f-8305-4871-b024-9faad9b24075 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:27.715984 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c817842f-8305-4871-b024-9faad9b24075 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:27.716502 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c817842f-8305-4871-b024-9faad9b24075 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:27.762490 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-84abb2f9-6228-4f19-b27c-0162d5d2bb10 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:27.763215 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-84abb2f9-6228-4f19-b27c-0162d5d2bb10 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:27.775049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-84abb2f9-6228-4f19-b27c-0162d5d2bb10 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:27.776359 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-84abb2f9-6228-4f19-b27c-0162d5d2bb10 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:27.782038 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-84abb2f9-6228-4f19-b27c-0162d5d2bb10 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:27.782777 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-84abb2f9-6228-4f19-b27c-0162d5d2bb10 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:27.922883 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c817842f-8305-4871-b024-9faad9b24075 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:27.932284 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c817842f-8305-4871-b024-9faad9b24075 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.234399 Jul 21 23:39:27.934446 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 86/157] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:27 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:27.941719 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-e7ca8964-9e2c-4711-a2ec-09a888983b39 req-823edad3-3140-48d8-8133-e52b05ccfd36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4395db50-179b-4591-bec9-a738ad477d31", "name": "network-vif-plugged", "status": "completed", "tag": "b7d67a8b-6367-4be6-bd44-466169d1217b"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:27.972792 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e7ca8964-9e2c-4711-a2ec-09a888983b39 req-823edad3-3140-48d8-8133-e52b05ccfd36 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:27.974616 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e7ca8964-9e2c-4711-a2ec-09a888983b39 req-823edad3-3140-48d8-8133-e52b05ccfd36 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:28.003014 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-e7ca8964-9e2c-4711-a2ec-09a888983b39 req-823edad3-3140-48d8-8133-e52b05ccfd36 service nova] Creating event network-vif-plugged:b7d67a8b-6367-4be6-bd44-466169d1217b for instance 4395db50-179b-4591-bec9-a738ad477d31 on hv-cinder-85070 Jul 21 23:39:28.012651 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-e7ca8964-9e2c-4711-a2ec-09a888983b39 req-823edad3-3140-48d8-8133-e52b05ccfd36 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076751 Jul 21 23:39:28.027351 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 87/158] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:39:28.068589 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-84abb2f9-6228-4f19-b27c-0162d5d2bb10 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:28.077732 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-84abb2f9-6228-4f19-b27c-0162d5d2bb10 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.320396 Jul 21 23:39:28.079733 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 72/159] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:27 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:28.345133 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-68c243ec-0908-445b-beb4-9c019895833b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:28.345871 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-68c243ec-0908-445b-beb4-9c019895833b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:28.356113 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-68c243ec-0908-445b-beb4-9c019895833b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:28.356461 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-68c243ec-0908-445b-beb4-9c019895833b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:28.357267 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-68c243ec-0908-445b-beb4-9c019895833b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:28.360455 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-68c243ec-0908-445b-beb4-9c019895833b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:28.536594 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-68c243ec-0908-445b-beb4-9c019895833b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:28.549146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-68c243ec-0908-445b-beb4-9c019895833b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:28.557288 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-68c243ec-0908-445b-beb4-9c019895833b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:28.561502 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-68c243ec-0908-445b-beb4-9c019895833b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1405 microversion: 2.20 time: 0.220300 Jul 21 23:39:28.566066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 88/160] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:28 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:28.721873 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ce9db076-fd25-4221-befd-b0c4eae36af2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:28.722596 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ce9db076-fd25-4221-befd-b0c4eae36af2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:28.729085 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ce9db076-fd25-4221-befd-b0c4eae36af2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:28.729554 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ce9db076-fd25-4221-befd-b0c4eae36af2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:28.731241 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ce9db076-fd25-4221-befd-b0c4eae36af2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:28.731980 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ce9db076-fd25-4221-befd-b0c4eae36af2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:28.891167 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ce9db076-fd25-4221-befd-b0c4eae36af2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:28.898561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ce9db076-fd25-4221-befd-b0c4eae36af2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.180711 Jul 21 23:39:28.899129 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 73/161] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:28 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:28.950908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f099231a-4718-4507-b00b-f374dc36e5e9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:28.951524 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f099231a-4718-4507-b00b-f374dc36e5e9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:28.957784 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f099231a-4718-4507-b00b-f374dc36e5e9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:28.958271 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f099231a-4718-4507-b00b-f374dc36e5e9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:28.959045 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f099231a-4718-4507-b00b-f374dc36e5e9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:28.959477 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f099231a-4718-4507-b00b-f374dc36e5e9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:29.102001 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-99d8696c-26b9-4f12-8c4a-1e20fad0a133 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:29.102962 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-99d8696c-26b9-4f12-8c4a-1e20fad0a133 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:29.121049 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f099231a-4718-4507-b00b-f374dc36e5e9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:29.128199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-99d8696c-26b9-4f12-8c4a-1e20fad0a133 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:29.128660 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-99d8696c-26b9-4f12-8c4a-1e20fad0a133 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:29.132006 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-99d8696c-26b9-4f12-8c4a-1e20fad0a133 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:29.133789 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-99d8696c-26b9-4f12-8c4a-1e20fad0a133 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:29.142369 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f099231a-4718-4507-b00b-f374dc36e5e9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.194672 Jul 21 23:39:29.143173 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 89/162] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:28 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:29.302564 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-99d8696c-26b9-4f12-8c4a-1e20fad0a133 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:29.312003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-99d8696c-26b9-4f12-8c4a-1e20fad0a133 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.214057 Jul 21 23:39:29.312621 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 74/163] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:29 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:29.584271 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0b47c0e3-4830-441b-b7a8-7fa26638a20f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:29.584862 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0b47c0e3-4830-441b-b7a8-7fa26638a20f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:29.605876 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b47c0e3-4830-441b-b7a8-7fa26638a20f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:29.606376 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b47c0e3-4830-441b-b7a8-7fa26638a20f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:29.610657 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b47c0e3-4830-441b-b7a8-7fa26638a20f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:29.614931 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b47c0e3-4830-441b-b7a8-7fa26638a20f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:29.892868 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0b47c0e3-4830-441b-b7a8-7fa26638a20f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:29.901375 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0b47c0e3-4830-441b-b7a8-7fa26638a20f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:29.903517 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0b47c0e3-4830-441b-b7a8-7fa26638a20f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:29.904952 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0b47c0e3-4830-441b-b7a8-7fa26638a20f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1598 microversion: 2.20 time: 0.325578 Jul 21 23:39:29.910591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 90/164] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:39:29 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1598 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:39:29.923997 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-13c577f1-fd04-4aea-9dc4-58bfe43cec76 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:29.924455 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c9da07ca-b2c1-4981-84f6-dd48da172830 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:29.924707 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-13c577f1-fd04-4aea-9dc4-58bfe43cec76 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:29.924950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c9da07ca-b2c1-4981-84f6-dd48da172830 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:29.935158 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9da07ca-b2c1-4981-84f6-dd48da172830 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:29.935845 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9da07ca-b2c1-4981-84f6-dd48da172830 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:29.936902 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9da07ca-b2c1-4981-84f6-dd48da172830 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:29.937036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13c577f1-fd04-4aea-9dc4-58bfe43cec76 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:29.937510 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13c577f1-fd04-4aea-9dc4-58bfe43cec76 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:29.937866 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9da07ca-b2c1-4981-84f6-dd48da172830 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:29.938291 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13c577f1-fd04-4aea-9dc4-58bfe43cec76 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:29.938734 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13c577f1-fd04-4aea-9dc4-58bfe43cec76 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:29.968883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=100 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:30.101258 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c9da07ca-b2c1-4981-84f6-dd48da172830 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.180409 Jul 21 23:39:30.102004 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 91/165] 10.222.0.57 () {60 vars in 1315 bytes} [Thu Jul 21 23:39:29 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:39:30.108848 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-2af60e15-a682-43e3-a265-5644226557cf req-d33cd935-7087-4dfd-bf0a-976fc429c7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "050a4396-33a9-4f73-bfa6-7ed26142ef29", "name": "network-vif-plugged", "status": "completed", "tag": "01ed1fe2-aa7a-432f-bed5-f261e1ca3563"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:30.125162 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-2af60e15-a682-43e3-a265-5644226557cf req-d33cd935-7087-4dfd-bf0a-976fc429c7e7 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:30.126105 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-2af60e15-a682-43e3-a265-5644226557cf req-d33cd935-7087-4dfd-bf0a-976fc429c7e7 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:30.148467 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-2af60e15-a682-43e3-a265-5644226557cf req-d33cd935-7087-4dfd-bf0a-976fc429c7e7 service nova] Creating event network-vif-plugged:01ed1fe2-aa7a-432f-bed5-f261e1ca3563 for instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 on hv-cinder-85070 Jul 21 23:39:30.154667 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-2af60e15-a682-43e3-a265-5644226557cf req-d33cd935-7087-4dfd-bf0a-976fc429c7e7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050623 Jul 21 23:39:30.155606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 92/166] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:39:30.160940 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-049d3e83-7072-4c06-bb6e-a9a5672ed50e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:30.162088 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-049d3e83-7072-4c06-bb6e-a9a5672ed50e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:30.169929 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-049d3e83-7072-4c06-bb6e-a9a5672ed50e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:30.170586 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-049d3e83-7072-4c06-bb6e-a9a5672ed50e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:30.172332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-049d3e83-7072-4c06-bb6e-a9a5672ed50e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:30.172935 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-049d3e83-7072-4c06-bb6e-a9a5672ed50e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:30.316430 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-13c577f1-fd04-4aea-9dc4-58bfe43cec76 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:30.326173 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-13c577f1-fd04-4aea-9dc4-58bfe43cec76 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.406085 Jul 21 23:39:30.327029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 75/167] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:29 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:30.332094 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b4c69902-d57f-4c79-9a5f-9b0db64c7150 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:30.333043 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b4c69902-d57f-4c79-9a5f-9b0db64c7150 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:30.340918 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b4c69902-d57f-4c79-9a5f-9b0db64c7150 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:30.341666 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b4c69902-d57f-4c79-9a5f-9b0db64c7150 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:30.342932 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b4c69902-d57f-4c79-9a5f-9b0db64c7150 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:30.343556 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b4c69902-d57f-4c79-9a5f-9b0db64c7150 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:30.440900 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-049d3e83-7072-4c06-bb6e-a9a5672ed50e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:30.463980 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-049d3e83-7072-4c06-bb6e-a9a5672ed50e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.307035 Jul 21 23:39:30.464844 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 93/168] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:30 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:30.688993 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b4c69902-d57f-4c79-9a5f-9b0db64c7150 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:30.697459 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b4c69902-d57f-4c79-9a5f-9b0db64c7150 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.368998 Jul 21 23:39:30.698026 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 76/169] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:30 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:31.346253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f3821c48-3d0e-4719-bd6a-d29c3298cf2a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:31.346871 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f3821c48-3d0e-4719-bd6a-d29c3298cf2a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:31.354211 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3821c48-3d0e-4719-bd6a-d29c3298cf2a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:31.355417 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3821c48-3d0e-4719-bd6a-d29c3298cf2a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:31.356499 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3821c48-3d0e-4719-bd6a-d29c3298cf2a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:31.357139 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3821c48-3d0e-4719-bd6a-d29c3298cf2a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:31.492156 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a90dd2ad-fc94-48c8-a46c-424bc0c151ce tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:31.492856 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-a90dd2ad-fc94-48c8-a46c-424bc0c151ce tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:31.504022 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=82 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:31.509540 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a90dd2ad-fc94-48c8-a46c-424bc0c151ce tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:31.509988 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a90dd2ad-fc94-48c8-a46c-424bc0c151ce tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:31.510904 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a90dd2ad-fc94-48c8-a46c-424bc0c151ce tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:31.511457 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a90dd2ad-fc94-48c8-a46c-424bc0c151ce tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:31.566443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f3821c48-3d0e-4719-bd6a-d29c3298cf2a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:31.586026 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f3821c48-3d0e-4719-bd6a-d29c3298cf2a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1367 microversion: 2.1 time: 0.245059 Jul 21 23:39:31.596814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 94/170] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:31 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:31.721902 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3aa4a9a7-fc04-4cfa-a431-94a4a20ab876 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:31.722264 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3aa4a9a7-fc04-4cfa-a431-94a4a20ab876 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:31.735446 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3aa4a9a7-fc04-4cfa-a431-94a4a20ab876 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:31.736880 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3aa4a9a7-fc04-4cfa-a431-94a4a20ab876 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:31.738490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3aa4a9a7-fc04-4cfa-a431-94a4a20ab876 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:31.739345 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3aa4a9a7-fc04-4cfa-a431-94a4a20ab876 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:31.919651 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a90dd2ad-fc94-48c8-a46c-424bc0c151ce tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:31.934286 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3aa4a9a7-fc04-4cfa-a431-94a4a20ab876 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:31.935491 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a90dd2ad-fc94-48c8-a46c-424bc0c151ce tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.457618 Jul 21 23:39:31.936304 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 77/171] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:31 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:31.946851 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3aa4a9a7-fc04-4cfa-a431-94a4a20ab876 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.230139 Jul 21 23:39:31.947435 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 95/172] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:31 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:32.260376 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-141d2dc0-d0d8-49a4-ac5c-5a5e16091aa7 req-88251ee8-3272-4e0a-801f-1983f4709483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb1e0d18-427a-456e-8ca0-c246e41f1fab", "tag": "7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:32.285793 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-141d2dc0-d0d8-49a4-ac5c-5a5e16091aa7 req-88251ee8-3272-4e0a-801f-1983f4709483 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:32.287190 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-141d2dc0-d0d8-49a4-ac5c-5a5e16091aa7 req-88251ee8-3272-4e0a-801f-1983f4709483 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:32.317111 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-141d2dc0-d0d8-49a4-ac5c-5a5e16091aa7 req-88251ee8-3272-4e0a-801f-1983f4709483 service nova] Creating event network-changed:7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8 for instance eb1e0d18-427a-456e-8ca0-c246e41f1fab on hv-cinder-85070 Jul 21 23:39:32.325710 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-141d2dc0-d0d8-49a4-ac5c-5a5e16091aa7 req-88251ee8-3272-4e0a-801f-1983f4709483 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084399 Jul 21 23:39:32.327159 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 78/173] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:39:32.608563 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-450f4f2f-162f-4869-9964-b248a75f4517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:32.614413 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-450f4f2f-162f-4869-9964-b248a75f4517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:32.633724 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-450f4f2f-162f-4869-9964-b248a75f4517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:32.634183 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-450f4f2f-162f-4869-9964-b248a75f4517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:32.643133 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-450f4f2f-162f-4869-9964-b248a75f4517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:32.654227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-450f4f2f-162f-4869-9964-b248a75f4517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:32.959340 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0a1012cd-3732-4e43-bba5-c1f78f789584 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:32.960046 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0a1012cd-3732-4e43-bba5-c1f78f789584 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:32.987512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a1012cd-3732-4e43-bba5-c1f78f789584 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:32.988167 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a1012cd-3732-4e43-bba5-c1f78f789584 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:32.989617 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a1012cd-3732-4e43-bba5-c1f78f789584 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:32.990214 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a1012cd-3732-4e43-bba5-c1f78f789584 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:33.011653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-450f4f2f-162f-4869-9964-b248a75f4517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:33.022656 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-450f4f2f-162f-4869-9964-b248a75f4517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1558 microversion: 2.1 time: 0.422215 Jul 21 23:39:33.023499 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 96/174] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:32 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1558 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:33.047497 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0a5e6943-5e00-48c1-b84f-7625a7d76a4a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:33.051071 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0a5e6943-5e00-48c1-b84f-7625a7d76a4a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:33.076463 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:33.084600 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a5e6943-5e00-48c1-b84f-7625a7d76a4a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:33.085045 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a5e6943-5e00-48c1-b84f-7625a7d76a4a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:33.085847 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a5e6943-5e00-48c1-b84f-7625a7d76a4a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:33.086281 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a5e6943-5e00-48c1-b84f-7625a7d76a4a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:33.383354 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0a1012cd-3732-4e43-bba5-c1f78f789584 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:33.397093 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0a1012cd-3732-4e43-bba5-c1f78f789584 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1315 microversion: 2.1 time: 0.447047 Jul 21 23:39:33.400291 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 79/175] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:32 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:33.414845 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4551ed8f-6b36-47d6-9fd7-5bd19033b92f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:33.418064 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4551ed8f-6b36-47d6-9fd7-5bd19033b92f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:33.434402 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4551ed8f-6b36-47d6-9fd7-5bd19033b92f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:33.435259 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4551ed8f-6b36-47d6-9fd7-5bd19033b92f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:33.438496 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4551ed8f-6b36-47d6-9fd7-5bd19033b92f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:33.439904 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0a5e6943-5e00-48c1-b84f-7625a7d76a4a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:33.440319 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4551ed8f-6b36-47d6-9fd7-5bd19033b92f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:33.456296 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0a5e6943-5e00-48c1-b84f-7625a7d76a4a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.427347 Jul 21 23:39:33.458085 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 97/176] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:33 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:33.652961 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4551ed8f-6b36-47d6-9fd7-5bd19033b92f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.251419 Jul 21 23:39:33.653796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 80/177] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 23:39:33 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-interface => generated 285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:39:34.433591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4f5e186f-3d5d-4a5c-bb72-a2f52ae7e066 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:34.434390 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4f5e186f-3d5d-4a5c-bb72-a2f52ae7e066 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:34.455446 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f5e186f-3d5d-4a5c-bb72-a2f52ae7e066 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:34.456139 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f5e186f-3d5d-4a5c-bb72-a2f52ae7e066 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:34.457056 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f5e186f-3d5d-4a5c-bb72-a2f52ae7e066 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:34.457659 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f5e186f-3d5d-4a5c-bb72-a2f52ae7e066 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:34.483865 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e7d22e73-74b3-44bb-85c9-1287ec33fcd9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:34.484551 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e7d22e73-74b3-44bb-85c9-1287ec33fcd9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:34.492609 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e7d22e73-74b3-44bb-85c9-1287ec33fcd9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:34.495891 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e7d22e73-74b3-44bb-85c9-1287ec33fcd9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:34.501098 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e7d22e73-74b3-44bb-85c9-1287ec33fcd9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:34.501803 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e7d22e73-74b3-44bb-85c9-1287ec33fcd9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:34.798366 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e7d22e73-74b3-44bb-85c9-1287ec33fcd9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:34.818000 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e7d22e73-74b3-44bb-85c9-1287ec33fcd9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.338427 Jul 21 23:39:34.827815 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 81/178] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:34 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:35.230591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4f5e186f-3d5d-4a5c-bb72-a2f52ae7e066 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:35.238048 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4f5e186f-3d5d-4a5c-bb72-a2f52ae7e066 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1502 microversion: 2.1 time: 0.825261 Jul 21 23:39:35.238864 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 98/179] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:34 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1502 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:35.759306 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-567df6dd-bf54-47c1-ab88-c57b95e9ea58 req-d0ec7aaf-eb5d-4a8a-a49c-39c26d95e38c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4395db50-179b-4591-bec9-a738ad477d31", "tag": "b7d67a8b-6367-4be6-bd44-466169d1217b"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:35.771676 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-567df6dd-bf54-47c1-ab88-c57b95e9ea58 req-d0ec7aaf-eb5d-4a8a-a49c-39c26d95e38c service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:35.772118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-567df6dd-bf54-47c1-ab88-c57b95e9ea58 req-d0ec7aaf-eb5d-4a8a-a49c-39c26d95e38c service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:35.789835 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-567df6dd-bf54-47c1-ab88-c57b95e9ea58 req-d0ec7aaf-eb5d-4a8a-a49c-39c26d95e38c service nova] Creating event network-changed:b7d67a8b-6367-4be6-bd44-466169d1217b for instance 4395db50-179b-4591-bec9-a738ad477d31 on hv-cinder-85070 Jul 21 23:39:35.800901 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-567df6dd-bf54-47c1-ab88-c57b95e9ea58 req-d0ec7aaf-eb5d-4a8a-a49c-39c26d95e38c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044598 Jul 21 23:39:35.802039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 82/180] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:39:35.835684 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-945782c6-12a8-48a9-9aee-ff9196119ffa tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:35.836869 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-945782c6-12a8-48a9-9aee-ff9196119ffa tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:35.846246 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-945782c6-12a8-48a9-9aee-ff9196119ffa tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:35.847053 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-945782c6-12a8-48a9-9aee-ff9196119ffa tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:35.847994 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-945782c6-12a8-48a9-9aee-ff9196119ffa tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:35.848580 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-945782c6-12a8-48a9-9aee-ff9196119ffa tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:36.070451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-945782c6-12a8-48a9-9aee-ff9196119ffa tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:36.070451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:36.077397 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-945782c6-12a8-48a9-9aee-ff9196119ffa tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.245611 Jul 21 23:39:36.079892 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 99/181] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:35 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:37.098670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2f499f54-2ec1-4370-b06b-79419d1be6d1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:37.100167 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2f499f54-2ec1-4370-b06b-79419d1be6d1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:37.108135 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2f499f54-2ec1-4370-b06b-79419d1be6d1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:37.108877 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2f499f54-2ec1-4370-b06b-79419d1be6d1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:37.109987 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2f499f54-2ec1-4370-b06b-79419d1be6d1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:37.110812 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2f499f54-2ec1-4370-b06b-79419d1be6d1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:37.266253 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2f499f54-2ec1-4370-b06b-79419d1be6d1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:37.273789 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2f499f54-2ec1-4370-b06b-79419d1be6d1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.179649 Jul 21 23:39:37.274355 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 83/182] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:37 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:38.291998 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-70bc5751-e699-416b-9a3f-d5980096d605 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:38.292602 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-70bc5751-e699-416b-9a3f-d5980096d605 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:38.299308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70bc5751-e699-416b-9a3f-d5980096d605 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:38.299763 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70bc5751-e699-416b-9a3f-d5980096d605 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:38.300529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70bc5751-e699-416b-9a3f-d5980096d605 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:38.300967 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70bc5751-e699-416b-9a3f-d5980096d605 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:38.447579 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-70bc5751-e699-416b-9a3f-d5980096d605 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:38.456136 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-70bc5751-e699-416b-9a3f-d5980096d605 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.168285 Jul 21 23:39:38.456710 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 100/183] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:38 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:38.835973 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9b4bd10f-c108-435c-b2f1-db6eafb08051 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bf1cf9e-8b6b-46c1-aee5-5f9663053bac"}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:38.838246 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9b4bd10f-c108-435c-b2f1-db6eafb08051 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:38.845577 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9b4bd10f-c108-435c-b2f1-db6eafb08051 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:38.846029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9b4bd10f-c108-435c-b2f1-db6eafb08051 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:38.846835 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9b4bd10f-c108-435c-b2f1-db6eafb08051 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:38.847271 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9b4bd10f-c108-435c-b2f1-db6eafb08051 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:39.237508 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9b4bd10f-c108-435c-b2f1-db6eafb08051 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "POST /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405883 Jul 21 23:39:39.238454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 84/184] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:39:38 2022] POST /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:39:39.473634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-39650f93-edeb-4810-917c-21dbab5e4355 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:39.474241 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-39650f93-edeb-4810-917c-21dbab5e4355 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:39.481834 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39650f93-edeb-4810-917c-21dbab5e4355 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:39.482109 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39650f93-edeb-4810-917c-21dbab5e4355 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:39.482883 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39650f93-edeb-4810-917c-21dbab5e4355 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:39.483319 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39650f93-edeb-4810-917c-21dbab5e4355 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:39.619228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-39650f93-edeb-4810-917c-21dbab5e4355 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:39.627771 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-39650f93-edeb-4810-917c-21dbab5e4355 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.158549 Jul 21 23:39:39.628322 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 101/185] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:39 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:40.649246 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f697692a-332c-4aa4-be5b-28d612f34660 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:40.649246 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f697692a-332c-4aa4-be5b-28d612f34660 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:40.655140 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f697692a-332c-4aa4-be5b-28d612f34660 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:40.655864 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f697692a-332c-4aa4-be5b-28d612f34660 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:40.657863 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f697692a-332c-4aa4-be5b-28d612f34660 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:40.658743 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f697692a-332c-4aa4-be5b-28d612f34660 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:40.845421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f697692a-332c-4aa4-be5b-28d612f34660 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:40.854750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f697692a-332c-4aa4-be5b-28d612f34660 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.212530 Jul 21 23:39:40.856308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 85/186] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:40 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:41.872794 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-43aa4cc8-b716-4b55-8340-72b81ab100f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:41.873439 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-43aa4cc8-b716-4b55-8340-72b81ab100f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:41.879454 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-43aa4cc8-b716-4b55-8340-72b81ab100f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:41.879899 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-43aa4cc8-b716-4b55-8340-72b81ab100f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:41.880656 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-43aa4cc8-b716-4b55-8340-72b81ab100f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:41.881090 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-43aa4cc8-b716-4b55-8340-72b81ab100f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:42.072523 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-43aa4cc8-b716-4b55-8340-72b81ab100f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:42.088158 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-43aa4cc8-b716-4b55-8340-72b81ab100f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.220153 Jul 21 23:39:42.093683 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 102/187] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:41 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:43.106077 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1c731c39-f2b1-43e6-893c-0b45d0fa0b6c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:43.107853 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1c731c39-f2b1-43e6-893c-0b45d0fa0b6c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:43.118402 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c731c39-f2b1-43e6-893c-0b45d0fa0b6c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:43.119034 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c731c39-f2b1-43e6-893c-0b45d0fa0b6c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:43.119981 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c731c39-f2b1-43e6-893c-0b45d0fa0b6c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:43.121157 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c731c39-f2b1-43e6-893c-0b45d0fa0b6c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:43.273142 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1c731c39-f2b1-43e6-893c-0b45d0fa0b6c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:43.282467 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1c731c39-f2b1-43e6-893c-0b45d0fa0b6c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.181188 Jul 21 23:39:43.283029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 86/188] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:43 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:44.299260 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-de30d7e7-3e05-46a0-a3b5-cc06230238f5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:44.299866 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-de30d7e7-3e05-46a0-a3b5-cc06230238f5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:44.306702 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-de30d7e7-3e05-46a0-a3b5-cc06230238f5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:44.307737 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-de30d7e7-3e05-46a0-a3b5-cc06230238f5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:44.308672 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-de30d7e7-3e05-46a0-a3b5-cc06230238f5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:44.309668 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-de30d7e7-3e05-46a0-a3b5-cc06230238f5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:44.474266 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-de30d7e7-3e05-46a0-a3b5-cc06230238f5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:44.484863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-de30d7e7-3e05-46a0-a3b5-cc06230238f5 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.189249 Jul 21 23:39:44.485516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 103/189] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:44 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:45.507901 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-13bb7606-0598-4600-a597-fe21a12c4897 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:45.508532 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-13bb7606-0598-4600-a597-fe21a12c4897 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:45.517636 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13bb7606-0598-4600-a597-fe21a12c4897 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:45.518328 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13bb7606-0598-4600-a597-fe21a12c4897 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:45.519285 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13bb7606-0598-4600-a597-fe21a12c4897 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:45.519870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13bb7606-0598-4600-a597-fe21a12c4897 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:45.693083 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-13bb7606-0598-4600-a597-fe21a12c4897 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:45.701047 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-13bb7606-0598-4600-a597-fe21a12c4897 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.200664 Jul 21 23:39:45.701802 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 87/190] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:45 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:46.718838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d2d81931-648b-47a0-84cc-d39342df6048 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:46.719962 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d2d81931-648b-47a0-84cc-d39342df6048 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:46.727268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d2d81931-648b-47a0-84cc-d39342df6048 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:46.728174 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d2d81931-648b-47a0-84cc-d39342df6048 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:46.729084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d2d81931-648b-47a0-84cc-d39342df6048 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:46.729548 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d2d81931-648b-47a0-84cc-d39342df6048 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:46.896637 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d2d81931-648b-47a0-84cc-d39342df6048 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:46.904407 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d2d81931-648b-47a0-84cc-d39342df6048 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.190904 Jul 21 23:39:46.904979 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 104/191] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:46 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:47.889720 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5b703478-9101-4da5-8d6a-1e85534e3e20 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:47.890198 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5b703478-9101-4da5-8d6a-1e85534e3e20 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:47.896510 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5b703478-9101-4da5-8d6a-1e85534e3e20 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:47.896959 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5b703478-9101-4da5-8d6a-1e85534e3e20 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:47.900368 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5b703478-9101-4da5-8d6a-1e85534e3e20 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:47.900368 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5b703478-9101-4da5-8d6a-1e85534e3e20 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:47.923383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ee95ceb3-d632-418a-9235-df9e096f1a2c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:47.924062 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ee95ceb3-d632-418a-9235-df9e096f1a2c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:47.924532 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5b703478-9101-4da5-8d6a-1e85534e3e20 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:39:47.930560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee95ceb3-d632-418a-9235-df9e096f1a2c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:47.931271 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee95ceb3-d632-418a-9235-df9e096f1a2c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:47.932220 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee95ceb3-d632-418a-9235-df9e096f1a2c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:47.932660 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee95ceb3-d632-418a-9235-df9e096f1a2c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:48.031698 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5b703478-9101-4da5-8d6a-1e85534e3e20 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "DELETE /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 204 len: 0 microversion: 2.1 time: 0.145552 Jul 21 23:39:48.032285 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 88/192] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:39:47 2022] DELETE /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:39:48.040605 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-17f99237-a88a-4cbb-ba7b-2e02d9d7a449 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:48.041981 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-17f99237-a88a-4cbb-ba7b-2e02d9d7a449 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:48.048533 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-17f99237-a88a-4cbb-ba7b-2e02d9d7a449 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:48.049333 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-17f99237-a88a-4cbb-ba7b-2e02d9d7a449 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:48.050251 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-17f99237-a88a-4cbb-ba7b-2e02d9d7a449 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:48.050844 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-17f99237-a88a-4cbb-ba7b-2e02d9d7a449 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:48.082374 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ee95ceb3-d632-418a-9235-df9e096f1a2c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:48.105454 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ee95ceb3-d632-418a-9235-df9e096f1a2c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.184988 Jul 21 23:39:48.106310 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 105/193] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:47 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:48.202716 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-17f99237-a88a-4cbb-ba7b-2e02d9d7a449 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:48.215157 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-17f99237-a88a-4cbb-ba7b-2e02d9d7a449 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1554 microversion: 2.1 time: 0.178502 Jul 21 23:39:48.217243 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 89/194] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:48 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:49.124226 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a97a7661-9a43-4b09-8002-f5e7a9064647 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:49.124830 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a97a7661-9a43-4b09-8002-f5e7a9064647 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:49.130899 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a97a7661-9a43-4b09-8002-f5e7a9064647 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:49.131461 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a97a7661-9a43-4b09-8002-f5e7a9064647 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:49.132216 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a97a7661-9a43-4b09-8002-f5e7a9064647 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:49.132664 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a97a7661-9a43-4b09-8002-f5e7a9064647 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:49.231917 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-21d32804-8f10-498c-a5ad-414037c209be tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:49.232711 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-21d32804-8f10-498c-a5ad-414037c209be tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:49.239368 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-21d32804-8f10-498c-a5ad-414037c209be tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:49.239815 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-21d32804-8f10-498c-a5ad-414037c209be tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:49.240570 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-21d32804-8f10-498c-a5ad-414037c209be tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:49.241004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-21d32804-8f10-498c-a5ad-414037c209be tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:49.275456 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:49.353662 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a97a7661-9a43-4b09-8002-f5e7a9064647 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:49.361934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a97a7661-9a43-4b09-8002-f5e7a9064647 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.242183 Jul 21 23:39:49.362703 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 106/195] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:49 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:49.498895 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-21d32804-8f10-498c-a5ad-414037c209be tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:49.507434 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-21d32804-8f10-498c-a5ad-414037c209be tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1554 microversion: 2.1 time: 0.279315 Jul 21 23:39:49.508141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 90/196] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:49 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1554 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:50.380586 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ce2e5221-adcd-4f98-a392-bc81810dcb13 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:50.382130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ce2e5221-adcd-4f98-a392-bc81810dcb13 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:50.392510 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce2e5221-adcd-4f98-a392-bc81810dcb13 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:50.393465 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce2e5221-adcd-4f98-a392-bc81810dcb13 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:50.394272 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce2e5221-adcd-4f98-a392-bc81810dcb13 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:50.395085 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce2e5221-adcd-4f98-a392-bc81810dcb13 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:50.530579 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e9141086-a2db-4b1f-b09b-9f164e43d639 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:50.531012 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e9141086-a2db-4b1f-b09b-9f164e43d639 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:50.536833 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e9141086-a2db-4b1f-b09b-9f164e43d639 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:50.537319 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e9141086-a2db-4b1f-b09b-9f164e43d639 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:50.538072 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e9141086-a2db-4b1f-b09b-9f164e43d639 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:50.538782 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e9141086-a2db-4b1f-b09b-9f164e43d639 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:50.558335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ce2e5221-adcd-4f98-a392-bc81810dcb13 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:50.574346 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ce2e5221-adcd-4f98-a392-bc81810dcb13 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.198120 Jul 21 23:39:50.576816 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 107/197] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:50 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:50.724511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e9141086-a2db-4b1f-b09b-9f164e43d639 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:50.734330 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e9141086-a2db-4b1f-b09b-9f164e43d639 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1554 microversion: 2.1 time: 0.212377 Jul 21 23:39:50.735298 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 91/198] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:50 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:51.593841 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3b96910e-fec1-4d5b-8cfb-2fb2532dcb9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:51.594455 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3b96910e-fec1-4d5b-8cfb-2fb2532dcb9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:51.601298 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b96910e-fec1-4d5b-8cfb-2fb2532dcb9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:51.601754 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b96910e-fec1-4d5b-8cfb-2fb2532dcb9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:51.602609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b96910e-fec1-4d5b-8cfb-2fb2532dcb9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:51.602980 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b96910e-fec1-4d5b-8cfb-2fb2532dcb9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:51.755617 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3b96910e-fec1-4d5b-8cfb-2fb2532dcb9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:51.759714 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-95b2b535-9932-4113-9776-d51d40cc2942 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:51.761499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-95b2b535-9932-4113-9776-d51d40cc2942 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:51.767756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-95b2b535-9932-4113-9776-d51d40cc2942 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:51.768206 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-95b2b535-9932-4113-9776-d51d40cc2942 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:51.768973 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-95b2b535-9932-4113-9776-d51d40cc2942 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:51.769424 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-95b2b535-9932-4113-9776-d51d40cc2942 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:51.773908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3b96910e-fec1-4d5b-8cfb-2fb2532dcb9d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.184389 Jul 21 23:39:51.784167 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 108/199] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:51 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:52.099107 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-95b2b535-9932-4113-9776-d51d40cc2942 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:52.100918 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-5694bdd8-d7c0-41a6-bddb-84305640cfe0 req-2f4f72be-28b2-4a53-afd8-1f9d7eab8eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "050a4396-33a9-4f73-bfa6-7ed26142ef29", "name": "network-vif-deleted", "tag": "01ed1fe2-aa7a-432f-bed5-f261e1ca3563"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:52.114362 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-5694bdd8-d7c0-41a6-bddb-84305640cfe0 req-2f4f72be-28b2-4a53-afd8-1f9d7eab8eb1 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:52.115588 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-5694bdd8-d7c0-41a6-bddb-84305640cfe0 req-2f4f72be-28b2-4a53-afd8-1f9d7eab8eb1 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:52.124306 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-95b2b535-9932-4113-9776-d51d40cc2942 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1554 microversion: 2.1 time: 0.374846 Jul 21 23:39:52.124835 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 92/200] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:51 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1554 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:52.137941 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-5694bdd8-d7c0-41a6-bddb-84305640cfe0 req-2f4f72be-28b2-4a53-afd8-1f9d7eab8eb1 service nova] Creating event network-vif-deleted:01ed1fe2-aa7a-432f-bed5-f261e1ca3563 for instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 on hv-cinder-85070 Jul 21 23:39:52.155380 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-5694bdd8-d7c0-41a6-bddb-84305640cfe0 req-2f4f72be-28b2-4a53-afd8-1f9d7eab8eb1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064244 Jul 21 23:39:52.156253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 109/201] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:39:52.791771 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-39a4bf7b-3935-4bb8-bd49-ce9f10b6debd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:52.792837 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-39a4bf7b-3935-4bb8-bd49-ce9f10b6debd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:52.802694 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-39a4bf7b-3935-4bb8-bd49-ce9f10b6debd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:52.803313 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-39a4bf7b-3935-4bb8-bd49-ce9f10b6debd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:52.804191 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-39a4bf7b-3935-4bb8-bd49-ce9f10b6debd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:52.804629 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-39a4bf7b-3935-4bb8-bd49-ce9f10b6debd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:53.144530 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-708793aa-dac0-4798-8d0c-8fde70b6bb74 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:53.145365 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-708793aa-dac0-4798-8d0c-8fde70b6bb74 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:53.153940 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-708793aa-dac0-4798-8d0c-8fde70b6bb74 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:53.154672 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-708793aa-dac0-4798-8d0c-8fde70b6bb74 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:53.155730 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-708793aa-dac0-4798-8d0c-8fde70b6bb74 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:53.156390 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-708793aa-dac0-4798-8d0c-8fde70b6bb74 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:53.195498 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-708793aa-dac0-4798-8d0c-8fde70b6bb74 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:53.195955 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-708793aa-dac0-4798-8d0c-8fde70b6bb74 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:53.196403 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-708793aa-dac0-4798-8d0c-8fde70b6bb74 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lazy-loading 'fault' on Instance uuid 050a4396-33a9-4f73-bfa6-7ed26142ef29 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:39:53.211243 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-39a4bf7b-3935-4bb8-bd49-ce9f10b6debd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:53.224128 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-39a4bf7b-3935-4bb8-bd49-ce9f10b6debd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1523 microversion: 2.1 time: 0.436615 Jul 21 23:39:53.226574 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 93/202] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:52 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1523 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:53.248035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-708793aa-dac0-4798-8d0c-8fde70b6bb74 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140a9484151c4904a25b6056f2e49520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d99b1f2c324aef91d2b56899ff631f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:53.256560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-708793aa-dac0-4798-8d0c-8fde70b6bb74 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 200 len: 1351 microversion: 2.1 time: 0.117626 Jul 21 23:39:53.257135 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 110/203] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:53 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 1351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:54.249417 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ab7fbf75-4a8d-4662-92ab-feb5188b652f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:54.249417 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ab7fbf75-4a8d-4662-92ab-feb5188b652f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:54.254857 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab7fbf75-4a8d-4662-92ab-feb5188b652f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:54.255739 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab7fbf75-4a8d-4662-92ab-feb5188b652f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:54.256696 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab7fbf75-4a8d-4662-92ab-feb5188b652f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:54.257139 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab7fbf75-4a8d-4662-92ab-feb5188b652f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:54.276784 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cfc28800-407f-463d-8cb1-a6d5d8c2df83 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:54.277693 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cfc28800-407f-463d-8cb1-a6d5d8c2df83 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:54.287070 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cfc28800-407f-463d-8cb1-a6d5d8c2df83 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:54.287650 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cfc28800-407f-463d-8cb1-a6d5d8c2df83 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:54.288829 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cfc28800-407f-463d-8cb1-a6d5d8c2df83 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:54.289536 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cfc28800-407f-463d-8cb1-a6d5d8c2df83 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:54.311048 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-cfc28800-407f-463d-8cb1-a6d5d8c2df83 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] HTTP exception thrown: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cfc28800-407f-463d-8cb1-a6d5d8c2df83 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Request method failure captured: Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 HTTP/1.1 Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOG0-zR7LcBxY6acV2LPZIuRSx2CAJx2fuuBh5eSC1m31tU5SSQUMT1-YurZW-LyeM58LuGt-n4t3oPSl2rzyrR7r9gVZc7DVlCKz7hAn4msetAsd6XrzDEZOvvsEZ4K6LncsMic0va_K5yH2bRmsgZa2ArCOXdkUJAiHLUoGHTlTQ Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 49d99b1f2c324aef91d2b56899ff631f Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:39:54.317373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/49d99b1f2c324aef91d2b56899ff631f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/49d99b1f2c324aef91d2b56899ff631f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_49d99b1f2c324aef91d2b56899ff631f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/49d99b1f2c324aef91d2b56899ff631f"}]}] Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 49d99b1f2c324aef91d2b56899ff631f Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-DeleteServersTestJSON-799162060-project Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 140a9484151c4904a25b6056f2e49520 Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-DeleteServersTestJSON-799162060-project Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:54.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '050a4396-33a9-4f73-bfa6-7ed26142ef29'} Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:39:54.319317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:54.320451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:39:54.323465 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cfc28800-407f-463d-8cb1-a6d5d8c2df83 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Returning 404 to user: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:39:54.324437 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cfc28800-407f-463d-8cb1-a6d5d8c2df83 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 404 len: 111 microversion: 2.1 time: 0.052159 Jul 21 23:39:54.325235 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 111/204] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:54 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:39:54.441307 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ab7fbf75-4a8d-4662-92ab-feb5188b652f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:54.452600 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ab7fbf75-4a8d-4662-92ab-feb5188b652f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1503 microversion: 2.1 time: 0.210444 Jul 21 23:39:54.453465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 94/205] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:54 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:39:54.469686 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-05b04438-321b-4195-afd6-57aed34d1ee7 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:54.470287 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-05b04438-321b-4195-afd6-57aed34d1ee7 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:54.477838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-05b04438-321b-4195-afd6-57aed34d1ee7 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:54.478351 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-05b04438-321b-4195-afd6-57aed34d1ee7 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:54.479885 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-05b04438-321b-4195-afd6-57aed34d1ee7 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:54.480373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-05b04438-321b-4195-afd6-57aed34d1ee7 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:54.496042 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-58d4ed30-39a4-4664-85e1-10ec537df9a9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:54.496982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-58d4ed30-39a4-4664-85e1-10ec537df9a9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:54.505690 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-58d4ed30-39a4-4664-85e1-10ec537df9a9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:54.506649 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-58d4ed30-39a4-4664-85e1-10ec537df9a9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:54.508004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-58d4ed30-39a4-4664-85e1-10ec537df9a9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:54.508613 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-58d4ed30-39a4-4664-85e1-10ec537df9a9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:54.533285 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-58d4ed30-39a4-4664-85e1-10ec537df9a9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] HTTP exception thrown: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-58d4ed30-39a4-4664-85e1-10ec537df9a9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Request method failure captured: Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29/os-volume_attachments HTTP/1.1 Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOG0-zR7LcBxY6acV2LPZIuRSx2CAJx2fuuBh5eSC1m31tU5SSQUMT1-YurZW-LyeM58LuGt-n4t3oPSl2rzyrR7r9gVZc7DVlCKz7hAn4msetAsd6XrzDEZOvvsEZ4K6LncsMic0va_K5yH2bRmsgZa2ArCOXdkUJAiHLUoGHTlTQ Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 49d99b1f2c324aef91d2b56899ff631f Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:39:54.538123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/49d99b1f2c324aef91d2b56899ff631f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/49d99b1f2c324aef91d2b56899ff631f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_49d99b1f2c324aef91d2b56899ff631f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/49d99b1f2c324aef91d2b56899ff631f"}]}] Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 49d99b1f2c324aef91d2b56899ff631f Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-DeleteServersTestJSON-799162060-project Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 140a9484151c4904a25b6056f2e49520 Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-DeleteServersTestJSON-799162060-project Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:54.539296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'server_id': '050a4396-33a9-4f73-bfa6-7ed26142ef29'} Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:39:54.540003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:54.542921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:39:54.544912 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-58d4ed30-39a4-4664-85e1-10ec537df9a9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Returning 404 to user: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:39:54.544912 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-58d4ed30-39a4-4664-85e1-10ec537df9a9 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049394 Jul 21 23:39:54.544912 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 95/206] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:39:54 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:39:54.653050 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-05b04438-321b-4195-afd6-57aed34d1ee7 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:54.664558 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-05b04438-321b-4195-afd6-57aed34d1ee7 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1514 microversion: 2.1 time: 0.198618 Jul 21 23:39:54.665826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 112/207] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:54 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:55.803339 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ab56d171-88b3-4532-9d02-041e0d5eb05e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:55.803833 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ab56d171-88b3-4532-9d02-041e0d5eb05e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:55.811196 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab56d171-88b3-4532-9d02-041e0d5eb05e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:55.811646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab56d171-88b3-4532-9d02-041e0d5eb05e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:55.812414 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab56d171-88b3-4532-9d02-041e0d5eb05e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:55.813011 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab56d171-88b3-4532-9d02-041e0d5eb05e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:55.827636 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-ab56d171-88b3-4532-9d02-041e0d5eb05e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] HTTP exception thrown: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ab56d171-88b3-4532-9d02-041e0d5eb05e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Request method failure captured: Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: DELETE /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 HTTP/1.1 Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOG0-zR7LcBxY6acV2LPZIuRSx2CAJx2fuuBh5eSC1m31tU5SSQUMT1-YurZW-LyeM58LuGt-n4t3oPSl2rzyrR7r9gVZc7DVlCKz7hAn4msetAsd6XrzDEZOvvsEZ4K6LncsMic0va_K5yH2bRmsgZa2ArCOXdkUJAiHLUoGHTlTQ Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 49d99b1f2c324aef91d2b56899ff631f Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:39:55.833036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/49d99b1f2c324aef91d2b56899ff631f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/49d99b1f2c324aef91d2b56899ff631f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_49d99b1f2c324aef91d2b56899ff631f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/49d99b1f2c324aef91d2b56899ff631f"}]}] Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 49d99b1f2c324aef91d2b56899ff631f Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-DeleteServersTestJSON-799162060-project Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 140a9484151c4904a25b6056f2e49520 Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-DeleteServersTestJSON-799162060-project Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:55.834365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': '050a4396-33a9-4f73-bfa6-7ed26142ef29'} Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:39:55.835008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:55.836127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:39:55.839636 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ab56d171-88b3-4532-9d02-041e0d5eb05e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Returning 404 to user: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:39:55.840701 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ab56d171-88b3-4532-9d02-041e0d5eb05e tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "DELETE /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 404 len: 111 microversion: 2.1 time: 0.041985 Jul 21 23:39:55.841476 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 96/208] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:39:55 2022] DELETE /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:39:55.850066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-585f3295-f6fb-4e8f-b033-4ec2bb4985d5 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:55.851497 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-585f3295-f6fb-4e8f-b033-4ec2bb4985d5 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] [instance: 050a4396-33a9-4f73-bfa6-7ed26142ef29] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:55.858888 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-585f3295-f6fb-4e8f-b033-4ec2bb4985d5 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:55.859716 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-585f3295-f6fb-4e8f-b033-4ec2bb4985d5 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:55.860675 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-585f3295-f6fb-4e8f-b033-4ec2bb4985d5 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:55.861352 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-585f3295-f6fb-4e8f-b033-4ec2bb4985d5 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:55.877967 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-585f3295-f6fb-4e8f-b033-4ec2bb4985d5 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] HTTP exception thrown: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-585f3295-f6fb-4e8f-b033-4ec2bb4985d5 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Request method failure captured: Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 HTTP/1.1 Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOG0-zR7LcBxY6acV2LPZIuRSx2CAJx2fuuBh5eSC1m31tU5SSQUMT1-YurZW-LyeM58LuGt-n4t3oPSl2rzyrR7r9gVZc7DVlCKz7hAn4msetAsd6XrzDEZOvvsEZ4K6LncsMic0va_K5yH2bRmsgZa2ArCOXdkUJAiHLUoGHTlTQ Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 49d99b1f2c324aef91d2b56899ff631f Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:39:55.882044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/49d99b1f2c324aef91d2b56899ff631f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/49d99b1f2c324aef91d2b56899ff631f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_49d99b1f2c324aef91d2b56899ff631f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/49d99b1f2c324aef91d2b56899ff631f"}]}] Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 49d99b1f2c324aef91d2b56899ff631f Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-DeleteServersTestJSON-799162060 Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-DeleteServersTestJSON-799162060-project Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 140a9484151c4904a25b6056f2e49520 Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-DeleteServersTestJSON-799162060-project Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:55.883223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '050a4396-33a9-4f73-bfa6-7ed26142ef29'} Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:39:55.883894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. Jul 21 23:39:55.885019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:39:55.887786 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-585f3295-f6fb-4e8f-b033-4ec2bb4985d5 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] Returning 404 to user: Instance 050a4396-33a9-4f73-bfa6-7ed26142ef29 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:39:55.888712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-585f3295-f6fb-4e8f-b033-4ec2bb4985d5 tempest-DeleteServersTestJSON-799162060 tempest-DeleteServersTestJSON-799162060-project] 10.222.0.57 "GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29" status: 404 len: 111 microversion: 2.1 time: 0.042585 Jul 21 23:39:55.893318 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 113/209] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:55 2022] GET /compute/v2.1/servers/050a4396-33a9-4f73-bfa6-7ed26142ef29 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:39:56.099726 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-af6a565f-9795-47cd-8201-a9fa2d25607b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:39:56.101225 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-af6a565f-9795-47cd-8201-a9fa2d25607b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:56.110050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-af6a565f-9795-47cd-8201-a9fa2d25607b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:56.110742 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-af6a565f-9795-47cd-8201-a9fa2d25607b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:56.111741 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-af6a565f-9795-47cd-8201-a9fa2d25607b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:56.112381 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-af6a565f-9795-47cd-8201-a9fa2d25607b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:56.154172 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.objects.instance [None req-af6a565f-9795-47cd-8201-a9fa2d25607b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lazy-loading 'flavor' on Instance uuid 7af6350f-5066-435f-bf01-5541dd1d3b18 {{(pid=124387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:39:56.362960 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-af6a565f-9795-47cd-8201-a9fa2d25607b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "POST /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18/action" status: 200 len: 32 microversion: 2.1 time: 0.266686 Jul 21 23:39:56.364761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 97/210] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:39:56 2022] POST /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18/action => generated 32 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:39:56.381804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f02689de-a9b2-40ff-b189-c1a03b10043b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:56.383899 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f02689de-a9b2-40ff-b189-c1a03b10043b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:56.425067 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f02689de-a9b2-40ff-b189-c1a03b10043b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:56.425558 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f02689de-a9b2-40ff-b189-c1a03b10043b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:56.426350 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f02689de-a9b2-40ff-b189-c1a03b10043b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:56.426775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f02689de-a9b2-40ff-b189-c1a03b10043b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:56.745827 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f02689de-a9b2-40ff-b189-c1a03b10043b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:56.764589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f02689de-a9b2-40ff-b189-c1a03b10043b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.394641 Jul 21 23:39:56.765680 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 114/211] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:56 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:57.784850 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f90c7b30-4872-4e84-b65c-413e3dc041b9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:57.795555 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f90c7b30-4872-4e84-b65c-413e3dc041b9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:57.809197 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f90c7b30-4872-4e84-b65c-413e3dc041b9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:57.809197 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f90c7b30-4872-4e84-b65c-413e3dc041b9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:57.809197 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f90c7b30-4872-4e84-b65c-413e3dc041b9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:57.815651 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f90c7b30-4872-4e84-b65c-413e3dc041b9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:58.192879 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f90c7b30-4872-4e84-b65c-413e3dc041b9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:58.201992 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f90c7b30-4872-4e84-b65c-413e3dc041b9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.423324 Jul 21 23:39:58.203119 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 98/212] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:57 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:39:59.219942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ae7b9290-1b52-430f-ab12-8ad561b8207e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:39:59.220637 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ae7b9290-1b52-430f-ab12-8ad561b8207e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:39:59.236929 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae7b9290-1b52-430f-ab12-8ad561b8207e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:59.237407 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae7b9290-1b52-430f-ab12-8ad561b8207e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:59.238652 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae7b9290-1b52-430f-ab12-8ad561b8207e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:39:59.239269 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae7b9290-1b52-430f-ab12-8ad561b8207e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:39:59.538757 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ae7b9290-1b52-430f-ab12-8ad561b8207e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:39:59.560531 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ae7b9290-1b52-430f-ab12-8ad561b8207e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.344413 Jul 21 23:39:59.561241 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 115/213] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:39:59 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:00.579656 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5729c26c-af57-49a0-8368-a149f7d5b59f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:00.580548 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5729c26c-af57-49a0-8368-a149f7d5b59f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:00.592264 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5729c26c-af57-49a0-8368-a149f7d5b59f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:00.592719 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5729c26c-af57-49a0-8368-a149f7d5b59f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:00.593532 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5729c26c-af57-49a0-8368-a149f7d5b59f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:00.596160 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5729c26c-af57-49a0-8368-a149f7d5b59f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:00.905611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5729c26c-af57-49a0-8368-a149f7d5b59f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:00.923954 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5729c26c-af57-49a0-8368-a149f7d5b59f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.348885 Jul 21 23:40:00.924519 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 99/214] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:00 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:01.943000 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cf918cd9-1fd2-4d19-91b3-809123af1854 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:01.943735 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cf918cd9-1fd2-4d19-91b3-809123af1854 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:01.951412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf918cd9-1fd2-4d19-91b3-809123af1854 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:01.951851 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf918cd9-1fd2-4d19-91b3-809123af1854 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:01.952849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf918cd9-1fd2-4d19-91b3-809123af1854 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:01.953470 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf918cd9-1fd2-4d19-91b3-809123af1854 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:02.148242 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cf918cd9-1fd2-4d19-91b3-809123af1854 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:02.156774 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cf918cd9-1fd2-4d19-91b3-809123af1854 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.218829 Jul 21 23:40:02.167669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 116/215] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:01 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:03.173985 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-81c8c1dd-3bc2-43a5-80b0-5237cd431f78 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:03.175682 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-81c8c1dd-3bc2-43a5-80b0-5237cd431f78 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:03.179534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:03.184059 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-81c8c1dd-3bc2-43a5-80b0-5237cd431f78 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:03.184634 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-81c8c1dd-3bc2-43a5-80b0-5237cd431f78 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:03.185559 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-81c8c1dd-3bc2-43a5-80b0-5237cd431f78 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:03.186219 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-81c8c1dd-3bc2-43a5-80b0-5237cd431f78 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:03.352203 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-81c8c1dd-3bc2-43a5-80b0-5237cd431f78 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:03.362827 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-81c8c1dd-3bc2-43a5-80b0-5237cd431f78 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.192680 Jul 21 23:40:03.365048 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 100/216] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:03 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:04.383271 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d34e1cc0-2dea-4a8b-a47c-cc9f6184c46b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:04.385090 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d34e1cc0-2dea-4a8b-a47c-cc9f6184c46b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:04.387193 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=42 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:04.394058 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d34e1cc0-2dea-4a8b-a47c-cc9f6184c46b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:04.394503 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d34e1cc0-2dea-4a8b-a47c-cc9f6184c46b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:04.395267 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d34e1cc0-2dea-4a8b-a47c-cc9f6184c46b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:04.395701 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d34e1cc0-2dea-4a8b-a47c-cc9f6184c46b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:04.601578 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d34e1cc0-2dea-4a8b-a47c-cc9f6184c46b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:04.613417 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d34e1cc0-2dea-4a8b-a47c-cc9f6184c46b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.234772 Jul 21 23:40:04.614267 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 117/217] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:04 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:40:05.630735 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1eafee49-ae77-4c72-abbe-bc47079aca97 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:05.632260 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1eafee49-ae77-4c72-abbe-bc47079aca97 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:05.641286 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1eafee49-ae77-4c72-abbe-bc47079aca97 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:05.642666 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1eafee49-ae77-4c72-abbe-bc47079aca97 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:05.643663 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1eafee49-ae77-4c72-abbe-bc47079aca97 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:05.644957 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1eafee49-ae77-4c72-abbe-bc47079aca97 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:05.868800 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1eafee49-ae77-4c72-abbe-bc47079aca97 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:05.879642 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1eafee49-ae77-4c72-abbe-bc47079aca97 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.252672 Jul 21 23:40:05.880822 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 101/218] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:05 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:06.902853 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6f425783-5da7-470c-bf0d-20011201f0f9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:06.903467 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6f425783-5da7-470c-bf0d-20011201f0f9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:06.919394 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6f425783-5da7-470c-bf0d-20011201f0f9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:06.919850 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6f425783-5da7-470c-bf0d-20011201f0f9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:06.920634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6f425783-5da7-470c-bf0d-20011201f0f9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:06.921122 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6f425783-5da7-470c-bf0d-20011201f0f9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:06.924001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:07.299541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6f425783-5da7-470c-bf0d-20011201f0f9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:07.310469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6f425783-5da7-470c-bf0d-20011201f0f9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.415057 Jul 21 23:40:07.324347 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 118/219] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:06 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:07.600518 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-64da65cf-9a2f-4208-97a8-bfdfeb46f29e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Action: 'create', calling method: .version_select at 0x7f7d28c1b9d0>, body: {"keypair": {"name": "tempest-keypair-1098807467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHcCZOvuIQXg2xXtz2CrNGklb5HYJOwkQqp8JL0U8WvcSALSeDKSCK8tHNrJWnx++T2sqnJUt1YkDATXG5dHpUqdowe20n2oIe+xH6weoLLQcm3MD/SDc7Ksh/wV1wbkQ=="}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:07.615439 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-64da65cf-9a2f-4208-97a8-bfdfeb46f29e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Getting quotas for project c9b5eb6ef5a942be9fcea8b26370a6fc. Resources: {'key_pairs'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:40:07.620661 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-64da65cf-9a2f-4208-97a8-bfdfeb46f29e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Getting quotas for user 2768181f8a814902b8dcf50ce32907d0 and project c9b5eb6ef5a942be9fcea8b26370a6fc. Resources: {'key_pairs'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:40:07.654094 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-64da65cf-9a2f-4208-97a8-bfdfeb46f29e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.231884 Jul 21 23:40:07.657420 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 102/220] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 23:40:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:40:08.332221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-30acf6bc-3a63-4931-bf1c-12f5df48c11b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:08.333050 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-30acf6bc-3a63-4931-bf1c-12f5df48c11b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:08.357724 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-30acf6bc-3a63-4931-bf1c-12f5df48c11b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:08.358225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-30acf6bc-3a63-4931-bf1c-12f5df48c11b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:08.359100 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-30acf6bc-3a63-4931-bf1c-12f5df48c11b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:08.359529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-30acf6bc-3a63-4931-bf1c-12f5df48c11b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:08.627420 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-30acf6bc-3a63-4931-bf1c-12f5df48c11b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:08.637082 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-30acf6bc-3a63-4931-bf1c-12f5df48c11b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.309800 Jul 21 23:40:08.641017 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 119/221] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:08 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:09.521033 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1906596021", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "def9c3d1-b527-4217-aca8-1be03de9052a"}], "security_groups": [{"name": "tempest-securitygroup--1766722199"}], "key_name": "tempest-keypair-1098807467", "user_data": "}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:09.664625 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1bb7972a-3f48-4cdd-9ad6-04c0ddc19967 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:09.664625 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1bb7972a-3f48-4cdd-9ad6-04c0ddc19967 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:09.665581 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] validate_networks() for [('def9c3d1-b527-4217-aca8-1be03de9052a', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:40:09.666360 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1bb7972a-3f48-4cdd-9ad6-04c0ddc19967 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:09.666813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1bb7972a-3f48-4cdd-9ad6-04c0ddc19967 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:09.667690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1bb7972a-3f48-4cdd-9ad6-04c0ddc19967 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:09.668129 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1bb7972a-3f48-4cdd-9ad6-04c0ddc19967 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:09.864325 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1bb7972a-3f48-4cdd-9ad6-04c0ddc19967 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:09.884793 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1bb7972a-3f48-4cdd-9ad6-04c0ddc19967 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.224547 Jul 21 23:40:09.886140 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 120/222] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:09 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:40:10.193679 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:40:10.194377 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:40:10.195098 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:40:10.195674 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:40:10.196309 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:40:10.218135 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:10.218588 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:10.219559 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:10.219997 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:10.255383 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Getting quotas for project c9b5eb6ef5a942be9fcea8b26370a6fc. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:40:10.260584 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Getting quotas for user 2768181f8a814902b8dcf50ce32907d0 and project c9b5eb6ef5a942be9fcea8b26370a6fc. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:40:10.272965 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:40:10.276111 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:40:10.339659 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bff217b5-45a3-4f46-bca7-d565e9a0ae22 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.824081 Jul 21 23:40:10.340767 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 103/223] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:40:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:40:10.353817 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a07feb72-61a7-41a1-9d63-9823b773dbca tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:10.354594 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a07feb72-61a7-41a1-9d63-9823b773dbca tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:10.437828 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a07feb72-61a7-41a1-9d63-9823b773dbca tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:10.446377 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a07feb72-61a7-41a1-9d63-9823b773dbca tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1238 microversion: 2.1 time: 0.097552 Jul 21 23:40:10.447777 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 121/224] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:10 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1238 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:10.903644 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0bb38012-f8b6-42ac-a1d5-84a54ca0ff8f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:10.904888 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0bb38012-f8b6-42ac-a1d5-84a54ca0ff8f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:10.913570 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0bb38012-f8b6-42ac-a1d5-84a54ca0ff8f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:10.914027 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0bb38012-f8b6-42ac-a1d5-84a54ca0ff8f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:10.914874 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0bb38012-f8b6-42ac-a1d5-84a54ca0ff8f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:10.915306 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0bb38012-f8b6-42ac-a1d5-84a54ca0ff8f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:11.064950 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0bb38012-f8b6-42ac-a1d5-84a54ca0ff8f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:11.078040 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0bb38012-f8b6-42ac-a1d5-84a54ca0ff8f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.179602 Jul 21 23:40:11.079883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 104/225] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:10 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:40:11.465750 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-acb5f6ae-4c47-4224-b1e6-453a554d27de tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:11.467213 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-acb5f6ae-4c47-4224-b1e6-453a554d27de tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:11.478740 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acb5f6ae-4c47-4224-b1e6-453a554d27de tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:11.479545 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acb5f6ae-4c47-4224-b1e6-453a554d27de tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:11.480570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acb5f6ae-4c47-4224-b1e6-453a554d27de tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:11.481251 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acb5f6ae-4c47-4224-b1e6-453a554d27de tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:11.592321 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-acb5f6ae-4c47-4224-b1e6-453a554d27de tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:11.601367 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-acb5f6ae-4c47-4224-b1e6-453a554d27de tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1242 microversion: 2.1 time: 0.140336 Jul 21 23:40:11.604211 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 122/226] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:11 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1242 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:12.095923 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c4fb5aae-a058-4f1c-8aea-1a5ac8ec2df4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:12.096681 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-c4fb5aae-a058-4f1c-8aea-1a5ac8ec2df4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:12.104185 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c4fb5aae-a058-4f1c-8aea-1a5ac8ec2df4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:12.104573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c4fb5aae-a058-4f1c-8aea-1a5ac8ec2df4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:12.105407 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c4fb5aae-a058-4f1c-8aea-1a5ac8ec2df4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:12.105850 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c4fb5aae-a058-4f1c-8aea-1a5ac8ec2df4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:12.333565 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c4fb5aae-a058-4f1c-8aea-1a5ac8ec2df4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:12.343985 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-c4fb5aae-a058-4f1c-8aea-1a5ac8ec2df4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.251483 Jul 21 23:40:12.345219 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 105/227] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:12 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:12.621128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2b2a5809-49d8-49e7-9b9b-b8d082b104d2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:12.622120 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2b2a5809-49d8-49e7-9b9b-b8d082b104d2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:12.630748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b2a5809-49d8-49e7-9b9b-b8d082b104d2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:12.631199 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b2a5809-49d8-49e7-9b9b-b8d082b104d2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:12.631969 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b2a5809-49d8-49e7-9b9b-b8d082b104d2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:12.632626 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b2a5809-49d8-49e7-9b9b-b8d082b104d2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:12.707114 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2b2a5809-49d8-49e7-9b9b-b8d082b104d2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:12.715184 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2b2a5809-49d8-49e7-9b9b-b8d082b104d2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1234 microversion: 2.1 time: 0.098675 Jul 21 23:40:12.715878 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 123/228] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:12 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1234 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:13.362328 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f1c5e185-5b6c-408e-85b1-b6b7658f5a0d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:13.363001 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f1c5e185-5b6c-408e-85b1-b6b7658f5a0d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:13.374605 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f1c5e185-5b6c-408e-85b1-b6b7658f5a0d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:13.375139 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f1c5e185-5b6c-408e-85b1-b6b7658f5a0d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:13.376028 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f1c5e185-5b6c-408e-85b1-b6b7658f5a0d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:13.377142 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f1c5e185-5b6c-408e-85b1-b6b7658f5a0d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:13.563696 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f1c5e185-5b6c-408e-85b1-b6b7658f5a0d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:13.573031 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f1c5e185-5b6c-408e-85b1-b6b7658f5a0d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1500 microversion: 2.1 time: 0.214844 Jul 21 23:40:13.573857 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 106/229] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:13 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1500 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:13.591001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6d88e4aa-be81-46f7-8310-d356ea351d3b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "767e6901-f0fd-4aef-a93b-52e7728b9c6d"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:13.592235 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6d88e4aa-be81-46f7-8310-d356ea351d3b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:13.603987 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d88e4aa-be81-46f7-8310-d356ea351d3b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:13.604696 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d88e4aa-be81-46f7-8310-d356ea351d3b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:13.605562 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d88e4aa-be81-46f7-8310-d356ea351d3b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:13.605995 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d88e4aa-be81-46f7-8310-d356ea351d3b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:13.630796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-6d88e4aa-be81-46f7-8310-d356ea351d3b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] HTTP exception thrown: Cannot 'attach_volume' instance 7af6350f-5066-435f-bf01-5541dd1d3b18 while it is in vm_state rescued Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6d88e4aa-be81-46f7-8310-d356ea351d3b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Request method failure captured: Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: POST /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18/os-volume_attachments HTTP/1.1 Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 74 Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOCyt5wNh_FEH36U-N0FQ8k_LyJAXtHZSu59k19ZVRspQaZUsZ2DfEOu4e8nxmFuU1dRPWLDo-7fs91ec5VLI_Y6xDsEXbioO6oijaevSZ7cyjgE4y4BNi72hFr6v9vZ7YV5VEpYuDxKOyg1RiPmTl3T5dBjovp0fu-vBs8xSx_6Gw Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 79b6d71ecbf94b7a81761727712881ea Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:40:13.632388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79b6d71ecbf94b7a81761727712881ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/79b6d71ecbf94b7a81761727712881ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_79b6d71ecbf94b7a81761727712881ea", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79b6d71ecbf94b7a81761727712881ea"}]}] Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 79b6d71ecbf94b7a81761727712881ea Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-ServerRescueNegativeTestJSON-777922945-project Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: b991805cfa834aab8dcab7d94d108ee2 Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777922945-project Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {"volumeAttachment": {"volumeId": "767e6901-f0fd-4aef-a93b-52e7728b9c6d"}} Jul 21 23:40:13.635959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Cannot 'attach_volume' instance 7af6350f-5066-435f-bf01-5541dd1d3b18 while it is in vm_state rescued Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'server_id': '7af6350f-5066-435f-bf01-5541dd1d3b18', 'body': {'volumeAttachment': {'volumeId': '767e6901-f0fd-4aef-a93b-52e7728b9c6d'}}} Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7af6350f-5066-435f-bf01-5541dd1d3b18 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:40:13.636820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7af6350f-5066-435f-bf01-5541dd1d3b18 while it is in vm_state rescued Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:40:13.640796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:40:13.643825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:40:13.643825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:40:13.643825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7af6350f-5066-435f-bf01-5541dd1d3b18 while it is in vm_state rescued Jul 21 23:40:13.643825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:40:13.643825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6d88e4aa-be81-46f7-8310-d356ea351d3b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Returning 409 to user: Cannot 'attach_volume' instance 7af6350f-5066-435f-bf01-5541dd1d3b18 while it is in vm_state rescued {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:40:13.643825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6d88e4aa-be81-46f7-8310-d356ea351d3b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "POST /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047577 Jul 21 23:40:13.643825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 124/230] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:40:13 2022] POST /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 23:40:13.645466 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0830dad3-ae48-424d-aab4-152a745d147b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:13.645466 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0830dad3-ae48-424d-aab4-152a745d147b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:13.651737 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0830dad3-ae48-424d-aab4-152a745d147b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:13.652192 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0830dad3-ae48-424d-aab4-152a745d147b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:13.653051 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0830dad3-ae48-424d-aab4-152a745d147b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:13.653542 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0830dad3-ae48-424d-aab4-152a745d147b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:13.693464 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:13.734519 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fd3a66c7-f38c-44b2-8c7d-5594f4c388b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:13.736363 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fd3a66c7-f38c-44b2-8c7d-5594f4c388b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:13.744991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0830dad3-ae48-424d-aab4-152a745d147b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "POST /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18/action" status: 202 len: 0 microversion: 2.1 time: 0.103922 Jul 21 23:40:13.749633 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 107/231] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:40:13 2022] POST /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:40:13.751599 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd3a66c7-f38c-44b2-8c7d-5594f4c388b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:13.755507 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-84cffefc-4d7e-41de-8f18-dabec1e65ba2 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:13.756063 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd3a66c7-f38c-44b2-8c7d-5594f4c388b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:13.756656 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-84cffefc-4d7e-41de-8f18-dabec1e65ba2 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:13.759687 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd3a66c7-f38c-44b2-8c7d-5594f4c388b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:13.761247 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd3a66c7-f38c-44b2-8c7d-5594f4c388b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:13.764608 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-84cffefc-4d7e-41de-8f18-dabec1e65ba2 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:13.765363 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-84cffefc-4d7e-41de-8f18-dabec1e65ba2 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:13.766405 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-84cffefc-4d7e-41de-8f18-dabec1e65ba2 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:13.767022 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-84cffefc-4d7e-41de-8f18-dabec1e65ba2 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:13.855627 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-fd3a66c7-f38c-44b2-8c7d-5594f4c388b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:13.867575 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fd3a66c7-f38c-44b2-8c7d-5594f4c388b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1298 microversion: 2.1 time: 0.138401 Jul 21 23:40:13.868490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 125/232] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:13 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1298 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:40:14.142010 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-84cffefc-4d7e-41de-8f18-dabec1e65ba2 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:14.151037 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-84cffefc-4d7e-41de-8f18-dabec1e65ba2 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1508 microversion: 2.1 time: 0.398817 Jul 21 23:40:14.151705 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 108/233] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:13 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1508 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:14.890183 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4726cca2-b18a-4619-8baa-f49cb2093284 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:14.890993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4726cca2-b18a-4619-8baa-f49cb2093284 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:14.899360 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4726cca2-b18a-4619-8baa-f49cb2093284 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:14.901287 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4726cca2-b18a-4619-8baa-f49cb2093284 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:14.902261 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4726cca2-b18a-4619-8baa-f49cb2093284 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:14.902777 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4726cca2-b18a-4619-8baa-f49cb2093284 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:15.067041 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4726cca2-b18a-4619-8baa-f49cb2093284 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:15.077583 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4726cca2-b18a-4619-8baa-f49cb2093284 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.191298 Jul 21 23:40:15.089918 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 126/234] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:14 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:15.170044 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-48c7aca8-74c8-4400-96ed-1744d013ad44 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:15.170044 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-48c7aca8-74c8-4400-96ed-1744d013ad44 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:15.175679 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48c7aca8-74c8-4400-96ed-1744d013ad44 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:15.176127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48c7aca8-74c8-4400-96ed-1744d013ad44 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:15.177220 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48c7aca8-74c8-4400-96ed-1744d013ad44 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:15.177687 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48c7aca8-74c8-4400-96ed-1744d013ad44 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:15.336945 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-48c7aca8-74c8-4400-96ed-1744d013ad44 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:15.345476 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-48c7aca8-74c8-4400-96ed-1744d013ad44 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1508 microversion: 2.1 time: 0.181417 Jul 21 23:40:15.346117 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 109/235] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:15 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:16.097560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1f10af4c-a702-4cd5-8f1c-f9f96f6a7473 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:16.098838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1f10af4c-a702-4cd5-8f1c-f9f96f6a7473 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:16.105012 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f10af4c-a702-4cd5-8f1c-f9f96f6a7473 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:16.105977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f10af4c-a702-4cd5-8f1c-f9f96f6a7473 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:16.107011 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f10af4c-a702-4cd5-8f1c-f9f96f6a7473 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:16.107512 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1f10af4c-a702-4cd5-8f1c-f9f96f6a7473 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:16.250469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1f10af4c-a702-4cd5-8f1c-f9f96f6a7473 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:16.260747 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1f10af4c-a702-4cd5-8f1c-f9f96f6a7473 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.166938 Jul 21 23:40:16.261494 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 127/236] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:16 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:16.364134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-76b30a3d-4bf0-45d6-95fd-31d7ace9329c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:16.364758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-76b30a3d-4bf0-45d6-95fd-31d7ace9329c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:16.379549 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-76b30a3d-4bf0-45d6-95fd-31d7ace9329c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:16.383237 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-76b30a3d-4bf0-45d6-95fd-31d7ace9329c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:16.384495 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-76b30a3d-4bf0-45d6-95fd-31d7ace9329c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:16.384937 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-76b30a3d-4bf0-45d6-95fd-31d7ace9329c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:16.836308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-76b30a3d-4bf0-45d6-95fd-31d7ace9329c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:16.844643 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-76b30a3d-4bf0-45d6-95fd-31d7ace9329c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1508 microversion: 2.1 time: 0.484515 Jul 21 23:40:16.848360 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 110/237] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:16 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1508 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:17.235274 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-03a011b9-9d70-4a10-acc7-544b86879473 req-6b19af6b-6bd6-476e-ab45-29c63ddad700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946cd660-c484-440f-873a-84c4c0a208fd", "tag": "bf3d7700-4f6a-4ed5-976f-d98d0af517ec"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:17.262493 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-03a011b9-9d70-4a10-acc7-544b86879473 req-6b19af6b-6bd6-476e-ab45-29c63ddad700 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:17.263239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-03a011b9-9d70-4a10-acc7-544b86879473 req-6b19af6b-6bd6-476e-ab45-29c63ddad700 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:17.278809 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d9e59ddf-7c59-49fd-894d-b3d0d47bca79 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:17.279624 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d9e59ddf-7c59-49fd-894d-b3d0d47bca79 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:17.291117 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-03a011b9-9d70-4a10-acc7-544b86879473 req-6b19af6b-6bd6-476e-ab45-29c63ddad700 service nova] Creating event network-changed:bf3d7700-4f6a-4ed5-976f-d98d0af517ec for instance 946cd660-c484-440f-873a-84c4c0a208fd on hv-cinder-85070 Jul 21 23:40:17.295501 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d9e59ddf-7c59-49fd-894d-b3d0d47bca79 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:17.295795 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d9e59ddf-7c59-49fd-894d-b3d0d47bca79 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:17.296576 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d9e59ddf-7c59-49fd-894d-b3d0d47bca79 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:17.297009 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d9e59ddf-7c59-49fd-894d-b3d0d47bca79 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:17.300939 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-03a011b9-9d70-4a10-acc7-544b86879473 req-6b19af6b-6bd6-476e-ab45-29c63ddad700 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071523 Jul 21 23:40:17.301773 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 128/238] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:40:17.620137 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d9e59ddf-7c59-49fd-894d-b3d0d47bca79 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:17.629238 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d9e59ddf-7c59-49fd-894d-b3d0d47bca79 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.354927 Jul 21 23:40:17.639937 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 111/239] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:17 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:40:17.869510 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ac9f13f0-84d8-4886-9aca-eb8b33921c63 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:17.870682 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ac9f13f0-84d8-4886-9aca-eb8b33921c63 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:17.880513 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac9f13f0-84d8-4886-9aca-eb8b33921c63 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:17.881963 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac9f13f0-84d8-4886-9aca-eb8b33921c63 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:17.882947 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac9f13f0-84d8-4886-9aca-eb8b33921c63 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:17.885253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ac9f13f0-84d8-4886-9aca-eb8b33921c63 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:18.128434 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ac9f13f0-84d8-4886-9aca-eb8b33921c63 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:18.137106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ac9f13f0-84d8-4886-9aca-eb8b33921c63 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1514 microversion: 2.1 time: 0.275349 Jul 21 23:40:18.139557 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 129/240] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:17 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:18.647777 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-09b645ca-3deb-418f-a340-5ece9224d89e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:18.648386 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-09b645ca-3deb-418f-a340-5ece9224d89e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:18.656806 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-09b645ca-3deb-418f-a340-5ece9224d89e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:18.657235 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-09b645ca-3deb-418f-a340-5ece9224d89e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:18.658214 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-09b645ca-3deb-418f-a340-5ece9224d89e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:18.658664 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-09b645ca-3deb-418f-a340-5ece9224d89e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:18.830660 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-09b645ca-3deb-418f-a340-5ece9224d89e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:18.843948 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-09b645ca-3deb-418f-a340-5ece9224d89e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.200468 Jul 21 23:40:18.844907 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 112/241] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:18 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:19.541919 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9f578de5-a947-42f1-ac10-4f75c9ffd044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Action: 'create', calling method: .version_select at 0x7f7d28cd4700>, body: {"keypair": {"name": "tempest-keypair-1461769049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKizzpx2HnwozxwX/xf3W7jqb01bKMm4DneBnnkTmit+SkbBBKP+dvYhaiN8aoW96vpuGVkt2obr6nL+XN0y3XnVQmt76fpV52QEz2ZkdTfEBd+bI06zFQneJB+jCGd+pg=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:19.557717 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-9f578de5-a947-42f1-ac10-4f75c9ffd044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Getting quotas for project 79b6d71ecbf94b7a81761727712881ea. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:40:19.562771 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-9f578de5-a947-42f1-ac10-4f75c9ffd044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Getting quotas for user b991805cfa834aab8dcab7d94d108ee2 and project 79b6d71ecbf94b7a81761727712881ea. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:40:19.597235 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9f578de5-a947-42f1-ac10-4f75c9ffd044 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057739 Jul 21 23:40:19.600012 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 130/242] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 23:40:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:40:19.863264 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d1dd4d61-0a85-4afb-8eb9-3e253b97641d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:19.864167 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d1dd4d61-0a85-4afb-8eb9-3e253b97641d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:19.876940 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d1dd4d61-0a85-4afb-8eb9-3e253b97641d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:19.878461 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d1dd4d61-0a85-4afb-8eb9-3e253b97641d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:19.882708 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d1dd4d61-0a85-4afb-8eb9-3e253b97641d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:19.883180 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d1dd4d61-0a85-4afb-8eb9-3e253b97641d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:20.245470 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d1dd4d61-0a85-4afb-8eb9-3e253b97641d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:20.255565 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:20.264508 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d1dd4d61-0a85-4afb-8eb9-3e253b97641d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.404836 Jul 21 23:40:20.265107 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 113/243] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:19 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:21.284556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e5979aa9-1f32-49a8-b2fc-340a5809c0a8 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:21.286270 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e5979aa9-1f32-49a8-b2fc-340a5809c0a8 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:21.294038 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e5979aa9-1f32-49a8-b2fc-340a5809c0a8 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:21.294757 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e5979aa9-1f32-49a8-b2fc-340a5809c0a8 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:21.295886 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e5979aa9-1f32-49a8-b2fc-340a5809c0a8 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:21.296738 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e5979aa9-1f32-49a8-b2fc-340a5809c0a8 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:21.346820 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-987975151", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54f97918-47c2-4d61-9f70-7fcf49dfea51"}], "security_groups": [{"name": "tempest-securitygroup--17485504"}], "key_name": "tempest-keypair-1461769049", "user_data": "}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:21.356901 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=10 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:21.468715 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e5979aa9-1f32-49a8-b2fc-340a5809c0a8 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:21.480411 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e5979aa9-1f32-49a8-b2fc-340a5809c0a8 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.201900 Jul 21 23:40:21.494278 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 131/244] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:21 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:21.533410 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] validate_networks() for [('54f97918-47c2-4d61-9f70-7fcf49dfea51', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:40:22.374780 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:40:22.375376 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:40:22.375849 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:40:22.376564 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:40:22.376984 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:40:22.391457 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:22.392067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:22.393012 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:22.393644 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:22.413813 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Getting quotas for project 79b6d71ecbf94b7a81761727712881ea. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:40:22.418470 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Getting quotas for user b991805cfa834aab8dcab7d94d108ee2 and project 79b6d71ecbf94b7a81761727712881ea. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:40:22.433278 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:40:22.435559 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:40:22.498448 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-872da272-1a9a-458e-9bfb-930bfbc55c06 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:22.499812 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-872da272-1a9a-458e-9bfb-930bfbc55c06 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:22.509618 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6441f807-cb22-4fc3-b4d4-95b65a2c7f94 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.163746 Jul 21 23:40:22.510888 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 114/245] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:40:21 2022] POST /compute/v2.1/servers => generated 407 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:40:22.517342 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-872da272-1a9a-458e-9bfb-930bfbc55c06 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:22.518081 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-872da272-1a9a-458e-9bfb-930bfbc55c06 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:22.519098 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-872da272-1a9a-458e-9bfb-930bfbc55c06 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:22.520792 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-677d80df-4c6c-4457-8a30-4ce89ce69637 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:22.521430 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-677d80df-4c6c-4457-8a30-4ce89ce69637 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:22.521980 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-872da272-1a9a-458e-9bfb-930bfbc55c06 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:22.603495 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-677d80df-4c6c-4457-8a30-4ce89ce69637 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:22.620966 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-677d80df-4c6c-4457-8a30-4ce89ce69637 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1245 microversion: 2.1 time: 0.104182 Jul 21 23:40:22.622076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 115/246] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:22 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:40:22.754254 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-872da272-1a9a-458e-9bfb-930bfbc55c06 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:22.765045 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-872da272-1a9a-458e-9bfb-930bfbc55c06 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.270829 Jul 21 23:40:22.767477 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 132/247] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:22 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:23.252683 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-09860e8c-7e43-4cbd-927f-f9cb5e149b4d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:23.253105 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-09860e8c-7e43-4cbd-927f-f9cb5e149b4d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:23.261453 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-09860e8c-7e43-4cbd-927f-f9cb5e149b4d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:23.261907 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-09860e8c-7e43-4cbd-927f-f9cb5e149b4d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:23.262695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-09860e8c-7e43-4cbd-927f-f9cb5e149b4d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:23.263131 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-09860e8c-7e43-4cbd-927f-f9cb5e149b4d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:23.290967 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-09860e8c-7e43-4cbd-927f-f9cb5e149b4d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/ips" status: 200 len: 151 microversion: 2.1 time: 0.041682 Jul 21 23:40:23.291858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 116/248] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 23:40:23 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:40:23.640233 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f54c04db-e032-4b1d-9431-950a932343d8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:23.641462 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f54c04db-e032-4b1d-9431-950a932343d8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:23.650163 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f54c04db-e032-4b1d-9431-950a932343d8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:23.651002 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f54c04db-e032-4b1d-9431-950a932343d8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:23.652231 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f54c04db-e032-4b1d-9431-950a932343d8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:23.653702 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f54c04db-e032-4b1d-9431-950a932343d8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:23.733911 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f54c04db-e032-4b1d-9431-950a932343d8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:23.741974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f54c04db-e032-4b1d-9431-950a932343d8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1249 microversion: 2.1 time: 0.106444 Jul 21 23:40:23.752950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 133/249] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:23 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1249 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:23.783279 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6ede0fd8-8740-4db9-a0d9-6c5ea6cd7860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:23.784769 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6ede0fd8-8740-4db9-a0d9-6c5ea6cd7860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:23.793275 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6ede0fd8-8740-4db9-a0d9-6c5ea6cd7860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:23.794075 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6ede0fd8-8740-4db9-a0d9-6c5ea6cd7860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:23.795801 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6ede0fd8-8740-4db9-a0d9-6c5ea6cd7860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:23.796502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6ede0fd8-8740-4db9-a0d9-6c5ea6cd7860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:24.053557 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6ede0fd8-8740-4db9-a0d9-6c5ea6cd7860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:24.062375 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6ede0fd8-8740-4db9-a0d9-6c5ea6cd7860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.283867 Jul 21 23:40:24.063513 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 117/250] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:23 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:24.765749 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-278a7010-a093-43b3-ac36-997f4adfaea8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:24.766821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-278a7010-a093-43b3-ac36-997f4adfaea8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:24.791434 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-278a7010-a093-43b3-ac36-997f4adfaea8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:24.793720 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-278a7010-a093-43b3-ac36-997f4adfaea8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:24.794530 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-278a7010-a093-43b3-ac36-997f4adfaea8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:24.797370 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-278a7010-a093-43b3-ac36-997f4adfaea8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:24.923170 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-278a7010-a093-43b3-ac36-997f4adfaea8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:24.937399 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-278a7010-a093-43b3-ac36-997f4adfaea8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1249 microversion: 2.1 time: 0.180016 Jul 21 23:40:24.941558 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 134/251] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:24 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1249 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:25.085747 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a0792af8-9a4d-449f-87d5-4a6cb3d841b9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:25.088242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-a0792af8-9a4d-449f-87d5-4a6cb3d841b9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:25.098994 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a0792af8-9a4d-449f-87d5-4a6cb3d841b9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:25.099777 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a0792af8-9a4d-449f-87d5-4a6cb3d841b9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:25.100881 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a0792af8-9a4d-449f-87d5-4a6cb3d841b9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:25.101492 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a0792af8-9a4d-449f-87d5-4a6cb3d841b9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:25.251258 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-a24ef0e3-0667-4f7e-b180-d8baca8f9171 req-97d442ca-7904-41fa-aed8-bf0d51bfa169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946cd660-c484-440f-873a-84c4c0a208fd", "name": "network-vif-plugged", "status": "completed", "tag": "bf3d7700-4f6a-4ed5-976f-d98d0af517ec"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:25.269601 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-a24ef0e3-0667-4f7e-b180-d8baca8f9171 req-97d442ca-7904-41fa-aed8-bf0d51bfa169 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:25.271126 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-a24ef0e3-0667-4f7e-b180-d8baca8f9171 req-97d442ca-7904-41fa-aed8-bf0d51bfa169 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:25.289591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-a24ef0e3-0667-4f7e-b180-d8baca8f9171 req-97d442ca-7904-41fa-aed8-bf0d51bfa169 service nova] Creating event network-vif-plugged:bf3d7700-4f6a-4ed5-976f-d98d0af517ec for instance 946cd660-c484-440f-873a-84c4c0a208fd on hv-cinder-85070 Jul 21 23:40:25.299113 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-a24ef0e3-0667-4f7e-b180-d8baca8f9171 req-97d442ca-7904-41fa-aed8-bf0d51bfa169 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051515 Jul 21 23:40:25.303595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 135/252] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:40:25.320932 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a0792af8-9a4d-449f-87d5-4a6cb3d841b9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:25.333469 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a0792af8-9a4d-449f-87d5-4a6cb3d841b9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.254135 Jul 21 23:40:25.337308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 118/253] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:25 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:25.918335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-433637eb-0eee-4d95-8b23-fc5dc653e71a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21021410-f25a-40a0-87ef-ae503129c704"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:25.919488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-433637eb-0eee-4d95-8b23-fc5dc653e71a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:25.925979 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-433637eb-0eee-4d95-8b23-fc5dc653e71a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:25.926426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-433637eb-0eee-4d95-8b23-fc5dc653e71a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:25.927353 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-433637eb-0eee-4d95-8b23-fc5dc653e71a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:25.927806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-433637eb-0eee-4d95-8b23-fc5dc653e71a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:25.962473 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ab2cd1e3-6aa7-4f43-994c-cace70bfe47b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:25.964437 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ab2cd1e3-6aa7-4f43-994c-cace70bfe47b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:25.971417 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab2cd1e3-6aa7-4f43-994c-cace70bfe47b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:25.971953 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab2cd1e3-6aa7-4f43-994c-cace70bfe47b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:25.972917 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab2cd1e3-6aa7-4f43-994c-cace70bfe47b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:25.973387 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ab2cd1e3-6aa7-4f43-994c-cace70bfe47b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:26.063953 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ab2cd1e3-6aa7-4f43-994c-cace70bfe47b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:26.074228 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ab2cd1e3-6aa7-4f43-994c-cace70bfe47b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1303 microversion: 2.1 time: 0.119362 Jul 21 23:40:26.082667 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 119/254] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:25 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:26.353782 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-00813fd6-694c-4990-a810-6c353c6ba324 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:26.355211 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-00813fd6-694c-4990-a810-6c353c6ba324 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:26.366033 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-00813fd6-694c-4990-a810-6c353c6ba324 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:26.366999 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-00813fd6-694c-4990-a810-6c353c6ba324 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:26.368958 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-00813fd6-694c-4990-a810-6c353c6ba324 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:26.369529 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-00813fd6-694c-4990-a810-6c353c6ba324 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:26.444191 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-433637eb-0eee-4d95-8b23-fc5dc653e71a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532237 Jul 21 23:40:26.450556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 136/255] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:40:25 2022] POST /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:40:26.705082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-00813fd6-694c-4990-a810-6c353c6ba324 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:26.717944 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-00813fd6-694c-4990-a810-6c353c6ba324 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.366721 Jul 21 23:40:26.722457 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 120/256] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:26 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:27.096044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a32d36dd-b52a-4bf0-ac33-f4f3d706ca03 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:27.098094 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a32d36dd-b52a-4bf0-ac33-f4f3d706ca03 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:27.113730 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a32d36dd-b52a-4bf0-ac33-f4f3d706ca03 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:27.114112 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a32d36dd-b52a-4bf0-ac33-f4f3d706ca03 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:27.119261 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a32d36dd-b52a-4bf0-ac33-f4f3d706ca03 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:27.120004 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a32d36dd-b52a-4bf0-ac33-f4f3d706ca03 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:27.126155 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:27.551424 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a32d36dd-b52a-4bf0-ac33-f4f3d706ca03 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:27.560159 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a32d36dd-b52a-4bf0-ac33-f4f3d706ca03 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1369 microversion: 2.1 time: 0.470185 Jul 21 23:40:27.560712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 137/257] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:27 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1369 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:27.738553 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-681d8f39-91b4-4685-9917-7e59b3bb7bc9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:27.740097 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-681d8f39-91b4-4685-9917-7e59b3bb7bc9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:27.765059 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-681d8f39-91b4-4685-9917-7e59b3bb7bc9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:27.769263 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-681d8f39-91b4-4685-9917-7e59b3bb7bc9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:27.772431 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-681d8f39-91b4-4685-9917-7e59b3bb7bc9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:27.776102 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-681d8f39-91b4-4685-9917-7e59b3bb7bc9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:28.020676 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-681d8f39-91b4-4685-9917-7e59b3bb7bc9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:28.033999 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-681d8f39-91b4-4685-9917-7e59b3bb7bc9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.301179 Jul 21 23:40:28.050103 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 121/258] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:27 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:28.174911 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7acc9720-8ff7-4f61-a69d-17930065f585 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:28.175377 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7acc9720-8ff7-4f61-a69d-17930065f585 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:28.192874 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7acc9720-8ff7-4f61-a69d-17930065f585 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:28.193885 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7acc9720-8ff7-4f61-a69d-17930065f585 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:28.198613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7acc9720-8ff7-4f61-a69d-17930065f585 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:28.199187 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7acc9720-8ff7-4f61-a69d-17930065f585 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:28.295196 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7acc9720-8ff7-4f61-a69d-17930065f585 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/ips" status: 200 len: 152 microversion: 2.20 time: 0.119274 Jul 21 23:40:28.296478 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 138/259] 10.222.0.57 () {60 vars in 1288 bytes} [Thu Jul 21 23:40:28 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/ips => generated 152 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:40:28.581510 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-53dcb274-5f14-4377-b355-7b4a12e4a47e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:28.582413 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-53dcb274-5f14-4377-b355-7b4a12e4a47e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:28.595399 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-53dcb274-5f14-4377-b355-7b4a12e4a47e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:28.596244 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-53dcb274-5f14-4377-b355-7b4a12e4a47e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:28.599215 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-53dcb274-5f14-4377-b355-7b4a12e4a47e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:28.599922 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-53dcb274-5f14-4377-b355-7b4a12e4a47e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:28.980737 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-53dcb274-5f14-4377-b355-7b4a12e4a47e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:28.989122 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-53dcb274-5f14-4377-b355-7b4a12e4a47e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1369 microversion: 2.1 time: 0.415144 Jul 21 23:40:28.994359 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 122/260] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:28 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1369 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:29.051508 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7473844b-3976-4684-82ef-03ad0a099512 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:29.052124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7473844b-3976-4684-82ef-03ad0a099512 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:29.088983 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7473844b-3976-4684-82ef-03ad0a099512 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:29.096429 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7473844b-3976-4684-82ef-03ad0a099512 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:29.100133 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7473844b-3976-4684-82ef-03ad0a099512 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:29.100595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7473844b-3976-4684-82ef-03ad0a099512 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:29.375363 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7473844b-3976-4684-82ef-03ad0a099512 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:29.387005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7473844b-3976-4684-82ef-03ad0a099512 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1364 microversion: 2.1 time: 0.339437 Jul 21 23:40:29.388027 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 139/261] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:29 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1364 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:30.011665 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b4b22027-1d35-455d-9454-a35f5030cccf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:30.012731 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b4b22027-1d35-455d-9454-a35f5030cccf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:30.029424 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b4b22027-1d35-455d-9454-a35f5030cccf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:30.030598 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b4b22027-1d35-455d-9454-a35f5030cccf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:30.032729 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b4b22027-1d35-455d-9454-a35f5030cccf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:30.038700 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b4b22027-1d35-455d-9454-a35f5030cccf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:30.404510 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7e3c060e-7101-4ca9-860a-cf9af67db898 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:30.405494 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7e3c060e-7101-4ca9-860a-cf9af67db898 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:30.423720 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:30.429359 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e3c060e-7101-4ca9-860a-cf9af67db898 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:30.436383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e3c060e-7101-4ca9-860a-cf9af67db898 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:30.449867 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e3c060e-7101-4ca9-860a-cf9af67db898 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:30.450696 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7e3c060e-7101-4ca9-860a-cf9af67db898 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:30.683947 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b4b22027-1d35-455d-9454-a35f5030cccf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:30.696559 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b4b22027-1d35-455d-9454-a35f5030cccf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1369 microversion: 2.1 time: 0.689319 Jul 21 23:40:30.697571 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 123/262] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:30 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1369 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:30.927563 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7e3c060e-7101-4ca9-860a-cf9af67db898 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:30.943609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7e3c060e-7101-4ca9-860a-cf9af67db898 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1550 microversion: 2.1 time: 0.542814 Jul 21 23:40:30.948942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 140/263] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:30 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1550 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:30.966022 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1b1f0eaf-bfde-40f6-a9ea-fe6988ea13a7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:30.966577 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1b1f0eaf-bfde-40f6-a9ea-fe6988ea13a7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:30.973702 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1b1f0eaf-bfde-40f6-a9ea-fe6988ea13a7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:30.974352 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1b1f0eaf-bfde-40f6-a9ea-fe6988ea13a7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:30.975117 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1b1f0eaf-bfde-40f6-a9ea-fe6988ea13a7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:30.975546 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1b1f0eaf-bfde-40f6-a9ea-fe6988ea13a7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:31.132024 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-839c8c5f-bf99-40f4-a994-85f3599cf675 req-a03844db-386a-4d6b-aeb4-9f21b329f642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b1ede1-a46a-454d-9b81-5b06de1124e9", "tag": "35c14d66-0050-4ea8-b943-7e894d33c3e5"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:31.147340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-839c8c5f-bf99-40f4-a994-85f3599cf675 req-a03844db-386a-4d6b-aeb4-9f21b329f642 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:31.153488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-839c8c5f-bf99-40f4-a994-85f3599cf675 req-a03844db-386a-4d6b-aeb4-9f21b329f642 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:31.180504 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-839c8c5f-bf99-40f4-a994-85f3599cf675 req-a03844db-386a-4d6b-aeb4-9f21b329f642 service nova] Creating event network-changed:35c14d66-0050-4ea8-b943-7e894d33c3e5 for instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 on hv-cinder-85070 Jul 21 23:40:31.194337 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-839c8c5f-bf99-40f4-a994-85f3599cf675 req-a03844db-386a-4d6b-aeb4-9f21b329f642 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072515 Jul 21 23:40:31.195578 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 141/264] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:40:31.216070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1b1f0eaf-bfde-40f6-a9ea-fe6988ea13a7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.256048 Jul 21 23:40:31.217802 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 124/265] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 23:40:30 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:40:31.347904 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8b06e2e9-345a-4b98-ac1f-85fc53da28eb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:31.349131 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8b06e2e9-345a-4b98-ac1f-85fc53da28eb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:31.369919 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b06e2e9-345a-4b98-ac1f-85fc53da28eb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:31.370086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b06e2e9-345a-4b98-ac1f-85fc53da28eb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:31.372850 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b06e2e9-345a-4b98-ac1f-85fc53da28eb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:31.373377 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b06e2e9-345a-4b98-ac1f-85fc53da28eb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:31.661093 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-8b06e2e9-345a-4b98-ac1f-85fc53da28eb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lazy-loading 'flavor' on Instance uuid eb1e0d18-427a-456e-8ca0-c246e41f1fab {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:40:31.714182 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5ef1f5b6-cf7d-4ad5-ad01-b620e86b80dc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:31.714796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5ef1f5b6-cf7d-4ad5-ad01-b620e86b80dc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:31.731793 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5ef1f5b6-cf7d-4ad5-ad01-b620e86b80dc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:31.732254 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5ef1f5b6-cf7d-4ad5-ad01-b620e86b80dc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:31.733049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5ef1f5b6-cf7d-4ad5-ad01-b620e86b80dc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:31.733524 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5ef1f5b6-cf7d-4ad5-ad01-b620e86b80dc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:32.098981 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5ef1f5b6-cf7d-4ad5-ad01-b620e86b80dc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:32.125340 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5ef1f5b6-cf7d-4ad5-ad01-b620e86b80dc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1369 microversion: 2.1 time: 0.414979 Jul 21 23:40:32.128437 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 125/266] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:31 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1369 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:40:32.215064 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8b06e2e9-345a-4b98-ac1f-85fc53da28eb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "POST /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/action" status: 202 len: 0 microversion: 2.20 time: 0.875314 Jul 21 23:40:32.216040 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 142/267] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jul 21 23:40:31 2022] POST /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/action => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:40:32.226614 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-cb93b16d-c2ac-4ee0-9bbc-f2a896d44cd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:32.229752 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-cb93b16d-c2ac-4ee0-9bbc-f2a896d44cd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:32.240509 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cb93b16d-c2ac-4ee0-9bbc-f2a896d44cd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:32.241277 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cb93b16d-c2ac-4ee0-9bbc-f2a896d44cd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:32.242735 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cb93b16d-c2ac-4ee0-9bbc-f2a896d44cd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:32.243886 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cb93b16d-c2ac-4ee0-9bbc-f2a896d44cd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:32.250311 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:32.402405 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:32.459845 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cb93b16d-c2ac-4ee0-9bbc-f2a896d44cd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:32.469212 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cb93b16d-c2ac-4ee0-9bbc-f2a896d44cd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:32.470926 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cb93b16d-c2ac-4ee0-9bbc-f2a896d44cd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:32.472319 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-cb93b16d-c2ac-4ee0-9bbc-f2a896d44cd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.251563 Jul 21 23:40:32.473111 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 126/268] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:32 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:33.147087 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-be817468-564a-4113-bf29-edba882d791c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:33.148060 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-be817468-564a-4113-bf29-edba882d791c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:33.176797 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be817468-564a-4113-bf29-edba882d791c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:33.177924 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be817468-564a-4113-bf29-edba882d791c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:33.178949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be817468-564a-4113-bf29-edba882d791c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:33.179595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be817468-564a-4113-bf29-edba882d791c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:33.496640 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3f35ab32-2a7c-4b64-be95-191b4e8efbc8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:33.498217 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3f35ab32-2a7c-4b64-be95-191b4e8efbc8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:33.557305 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=8 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:33.558706 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:33.565050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3f35ab32-2a7c-4b64-be95-191b4e8efbc8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:33.568395 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3f35ab32-2a7c-4b64-be95-191b4e8efbc8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:33.569447 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3f35ab32-2a7c-4b64-be95-191b4e8efbc8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:33.569905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3f35ab32-2a7c-4b64-be95-191b4e8efbc8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:33.666401 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-be817468-564a-4113-bf29-edba882d791c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:33.675527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-be817468-564a-4113-bf29-edba882d791c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1369 microversion: 2.1 time: 0.533900 Jul 21 23:40:33.686553 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 143/269] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:33 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1369 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:33.987429 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-53afe340-d6e1-409f-8d45-f9a80a27caa6 req-f6d2a44f-2640-4f95-b3d5-0ac0569d75d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946cd660-c484-440f-873a-84c4c0a208fd", "tag": "bf3d7700-4f6a-4ed5-976f-d98d0af517ec"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:33.999277 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-53afe340-d6e1-409f-8d45-f9a80a27caa6 req-f6d2a44f-2640-4f95-b3d5-0ac0569d75d5 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:33.999942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-53afe340-d6e1-409f-8d45-f9a80a27caa6 req-f6d2a44f-2640-4f95-b3d5-0ac0569d75d5 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:34.014588 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-53afe340-d6e1-409f-8d45-f9a80a27caa6 req-f6d2a44f-2640-4f95-b3d5-0ac0569d75d5 service nova] Creating event network-changed:bf3d7700-4f6a-4ed5-976f-d98d0af517ec for instance 946cd660-c484-440f-873a-84c4c0a208fd on hv-cinder-85070 Jul 21 23:40:34.026649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-53afe340-d6e1-409f-8d45-f9a80a27caa6 req-f6d2a44f-2640-4f95-b3d5-0ac0569d75d5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042793 Jul 21 23:40:34.031175 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 144/270] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:40:34.327911 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3f35ab32-2a7c-4b64-be95-191b4e8efbc8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:34.336611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3f35ab32-2a7c-4b64-be95-191b4e8efbc8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:34.341440 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3f35ab32-2a7c-4b64-be95-191b4e8efbc8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:34.344289 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3f35ab32-2a7c-4b64-be95-191b4e8efbc8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.855934 Jul 21 23:40:34.345845 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 127/271] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:33 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:40:34.704055 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-36c00ddc-abbb-4157-b60c-c2b1dae84f3a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:34.704917 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-36c00ddc-abbb-4157-b60c-c2b1dae84f3a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:34.708619 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:34.714877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36c00ddc-abbb-4157-b60c-c2b1dae84f3a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:34.715327 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36c00ddc-abbb-4157-b60c-c2b1dae84f3a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:34.716101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36c00ddc-abbb-4157-b60c-c2b1dae84f3a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:34.716535 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36c00ddc-abbb-4157-b60c-c2b1dae84f3a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:34.891357 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-36c00ddc-abbb-4157-b60c-c2b1dae84f3a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:34.902039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-36c00ddc-abbb-4157-b60c-c2b1dae84f3a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1369 microversion: 2.1 time: 0.202451 Jul 21 23:40:34.906185 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 145/272] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:34 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1369 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:35.364076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c720529a-4c37-4659-a3b6-119d0866bc9b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:35.364852 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-c720529a-4c37-4659-a3b6-119d0866bc9b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:35.372881 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c720529a-4c37-4659-a3b6-119d0866bc9b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:35.373443 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c720529a-4c37-4659-a3b6-119d0866bc9b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:35.374278 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c720529a-4c37-4659-a3b6-119d0866bc9b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:35.374771 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c720529a-4c37-4659-a3b6-119d0866bc9b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:35.519155 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c720529a-4c37-4659-a3b6-119d0866bc9b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:35.527770 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c720529a-4c37-4659-a3b6-119d0866bc9b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:35.529402 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c720529a-4c37-4659-a3b6-119d0866bc9b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:35.530803 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-c720529a-4c37-4659-a3b6-119d0866bc9b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.170731 Jul 21 23:40:35.531488 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 128/273] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:35 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:35.925555 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-533cb870-c537-4c76-9e24-199728a7e8c9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:35.926195 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-533cb870-c537-4c76-9e24-199728a7e8c9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:35.939463 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-533cb870-c537-4c76-9e24-199728a7e8c9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:35.940176 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-533cb870-c537-4c76-9e24-199728a7e8c9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:35.940953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-533cb870-c537-4c76-9e24-199728a7e8c9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:35.941469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-533cb870-c537-4c76-9e24-199728a7e8c9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:36.108763 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-533cb870-c537-4c76-9e24-199728a7e8c9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:36.122134 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-533cb870-c537-4c76-9e24-199728a7e8c9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1369 microversion: 2.1 time: 0.202817 Jul 21 23:40:36.134097 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 146/274] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:35 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1369 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:36.550412 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7cde34ae-736e-4d18-b9f9-6703ad2eaaa1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:36.551666 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7cde34ae-736e-4d18-b9f9-6703ad2eaaa1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:36.562731 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7cde34ae-736e-4d18-b9f9-6703ad2eaaa1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:36.563457 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7cde34ae-736e-4d18-b9f9-6703ad2eaaa1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:36.564402 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7cde34ae-736e-4d18-b9f9-6703ad2eaaa1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:36.564995 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7cde34ae-736e-4d18-b9f9-6703ad2eaaa1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:36.756373 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7cde34ae-736e-4d18-b9f9-6703ad2eaaa1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:36.770205 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7cde34ae-736e-4d18-b9f9-6703ad2eaaa1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:36.773028 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7cde34ae-736e-4d18-b9f9-6703ad2eaaa1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:36.780600 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7cde34ae-736e-4d18-b9f9-6703ad2eaaa1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.233755 Jul 21 23:40:36.781332 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 129/275] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:36 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:37.142100 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-06b55811-4922-4116-843e-ef74c03083f3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:37.143607 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-06b55811-4922-4116-843e-ef74c03083f3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:37.171536 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-06b55811-4922-4116-843e-ef74c03083f3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:37.176363 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-06b55811-4922-4116-843e-ef74c03083f3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:37.177955 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-06b55811-4922-4116-843e-ef74c03083f3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:37.179167 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-06b55811-4922-4116-843e-ef74c03083f3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:37.461675 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-06b55811-4922-4116-843e-ef74c03083f3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:37.470949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-06b55811-4922-4116-843e-ef74c03083f3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1369 microversion: 2.1 time: 0.334755 Jul 21 23:40:37.472230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 147/276] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:37 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1369 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:37.803097 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e93af199-8cf4-432f-930a-0fbaad8cad86 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:37.804526 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e93af199-8cf4-432f-930a-0fbaad8cad86 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:37.824025 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e93af199-8cf4-432f-930a-0fbaad8cad86 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:37.826501 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e93af199-8cf4-432f-930a-0fbaad8cad86 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:37.827956 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e93af199-8cf4-432f-930a-0fbaad8cad86 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:37.829116 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e93af199-8cf4-432f-930a-0fbaad8cad86 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:38.232966 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e93af199-8cf4-432f-930a-0fbaad8cad86 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:38.255688 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e93af199-8cf4-432f-930a-0fbaad8cad86 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:38.272817 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e93af199-8cf4-432f-930a-0fbaad8cad86 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:38.274965 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e93af199-8cf4-432f-930a-0fbaad8cad86 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.479157 Jul 21 23:40:38.291803 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 130/277] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:37 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:38.388840 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-64fc3051-74e1-43b7-bb31-aec459dc3aa2 req-ee4c0bfa-e1ed-4edd-9c9b-75b463bcfb03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b1ede1-a46a-454d-9b81-5b06de1124e9", "name": "network-vif-plugged", "status": "completed", "tag": "35c14d66-0050-4ea8-b943-7e894d33c3e5"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:38.412301 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-64fc3051-74e1-43b7-bb31-aec459dc3aa2 req-ee4c0bfa-e1ed-4edd-9c9b-75b463bcfb03 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:38.413230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-64fc3051-74e1-43b7-bb31-aec459dc3aa2 req-ee4c0bfa-e1ed-4edd-9c9b-75b463bcfb03 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:38.436011 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-64fc3051-74e1-43b7-bb31-aec459dc3aa2 req-ee4c0bfa-e1ed-4edd-9c9b-75b463bcfb03 service nova] Creating event network-vif-plugged:35c14d66-0050-4ea8-b943-7e894d33c3e5 for instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 on hv-cinder-85070 Jul 21 23:40:38.465207 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-64fc3051-74e1-43b7-bb31-aec459dc3aa2 req-ee4c0bfa-e1ed-4edd-9c9b-75b463bcfb03 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075617 Jul 21 23:40:38.466171 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 148/278] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:40:38.489271 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4e7afd82-5ea9-4b36-a057-79efc0312675 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:38.490144 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4e7afd82-5ea9-4b36-a057-79efc0312675 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:38.502911 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4e7afd82-5ea9-4b36-a057-79efc0312675 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:38.503575 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4e7afd82-5ea9-4b36-a057-79efc0312675 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:38.510694 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4e7afd82-5ea9-4b36-a057-79efc0312675 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:38.511544 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4e7afd82-5ea9-4b36-a057-79efc0312675 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:38.906252 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bbe05750-09a7-4a51-8c3f-dceeb84891b4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: .version_select at 0x7f7d28d70790>, body: {"keypair": {"name": "tempest-keypair-1387581402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjiC41Tr1Spz+t78PqT/4Z28EfT56md1NeKUQA/cVl5KP72y3h9GAjzusnJX0hEFtJ6zzRaq3QJ+JZoEFMn4zHzVVxBO/cFUoJyiWJo/KpuN6DNQIn/i9RTn4UNk0gs5A=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:38.923971 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-bbe05750-09a7-4a51-8c3f-dceeb84891b4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for project fc4faed5bed7450da8122eeb77459f3a. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:40:38.928682 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-bbe05750-09a7-4a51-8c3f-dceeb84891b4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for user c44b88237c0f4ae7a31fbaaddbb2d427 and project fc4faed5bed7450da8122eeb77459f3a. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:40:38.965949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bbe05750-09a7-4a51-8c3f-dceeb84891b4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064425 Jul 21 23:40:38.968310 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 149/279] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 23:40:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:40:39.184610 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4e7afd82-5ea9-4b36-a057-79efc0312675 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:39.199035 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4e7afd82-5ea9-4b36-a057-79efc0312675 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1369 microversion: 2.1 time: 0.714947 Jul 21 23:40:39.202311 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 131/280] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:38 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1369 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:39.296401 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1d9221b7-5f63-4865-b435-919b8d512cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:39.297503 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1d9221b7-5f63-4865-b435-919b8d512cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:39.308557 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d9221b7-5f63-4865-b435-919b8d512cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:39.309459 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d9221b7-5f63-4865-b435-919b8d512cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:39.310848 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d9221b7-5f63-4865-b435-919b8d512cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:39.311635 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1d9221b7-5f63-4865-b435-919b8d512cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:39.522470 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1d9221b7-5f63-4865-b435-919b8d512cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:39.535436 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1d9221b7-5f63-4865-b435-919b8d512cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:39.537887 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1d9221b7-5f63-4865-b435-919b8d512cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:39.540486 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1d9221b7-5f63-4865-b435-919b8d512cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.249665 Jul 21 23:40:39.541571 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 150/281] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:39 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:40.223350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1b5c583d-2381-4367-a41d-8d8c2fd79e3e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:40.224020 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1b5c583d-2381-4367-a41d-8d8c2fd79e3e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:40.243546 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1b5c583d-2381-4367-a41d-8d8c2fd79e3e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:40.244006 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1b5c583d-2381-4367-a41d-8d8c2fd79e3e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:40.260157 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1b5c583d-2381-4367-a41d-8d8c2fd79e3e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:40.260615 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1b5c583d-2381-4367-a41d-8d8c2fd79e3e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:40.558953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-84d42a2d-e787-472d-87d1-104b0e626d9d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:40.559567 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-84d42a2d-e787-472d-87d1-104b0e626d9d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:40.566256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-84d42a2d-e787-472d-87d1-104b0e626d9d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:40.566733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-84d42a2d-e787-472d-87d1-104b0e626d9d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:40.567503 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-84d42a2d-e787-472d-87d1-104b0e626d9d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:40.572515 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-84d42a2d-e787-472d-87d1-104b0e626d9d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:40.669866 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1b5c583d-2381-4367-a41d-8d8c2fd79e3e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:40.684180 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1b5c583d-2381-4367-a41d-8d8c2fd79e3e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1369 microversion: 2.1 time: 0.463891 Jul 21 23:40:40.691579 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 132/282] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:40 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1369 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:40.837356 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-84d42a2d-e787-472d-87d1-104b0e626d9d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:40.852488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-84d42a2d-e787-472d-87d1-104b0e626d9d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:40.854129 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-84d42a2d-e787-472d-87d1-104b0e626d9d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:40.855331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-84d42a2d-e787-472d-87d1-104b0e626d9d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.301001 Jul 21 23:40:40.857989 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 151/283] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:40 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:41.175976 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2095749203", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db7b04fe-74b8-4a1d-b84d-14b166fb83d5"}], "security_groups": [{"name": "tempest-securitygroup--734498378"}], "key_name": "tempest-keypair-1387581402", "user_data": "}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:41.300836 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] validate_networks() for [('db7b04fe-74b8-4a1d-b84d-14b166fb83d5', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:40:41.701335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5088d3ed-be02-47e9-b641-0b5a28704e8c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:41.702494 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5088d3ed-be02-47e9-b641-0b5a28704e8c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:41.713718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5088d3ed-be02-47e9-b641-0b5a28704e8c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:41.714156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5088d3ed-be02-47e9-b641-0b5a28704e8c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:41.714926 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5088d3ed-be02-47e9-b641-0b5a28704e8c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:41.715359 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5088d3ed-be02-47e9-b641-0b5a28704e8c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:41.878667 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:40:41.879506 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:40:41.880380 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:40:41.881109 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:40:41.881877 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:40:41.906225 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:41.907031 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:41.909366 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:41.910391 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:41.949354 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for project fc4faed5bed7450da8122eeb77459f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:40:41.955705 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for user c44b88237c0f4ae7a31fbaaddbb2d427 and project fc4faed5bed7450da8122eeb77459f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:40:41.986765 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5088d3ed-be02-47e9-b641-0b5a28704e8c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:41.995549 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:40:42.000060 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:40:42.005422 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5088d3ed-be02-47e9-b641-0b5a28704e8c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1563 microversion: 2.1 time: 0.307483 Jul 21 23:40:42.018475 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 152/284] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:41 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1563 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:42.024314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b2aa873b-8742-4336-a04c-2d6e830e751c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:42.024314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b2aa873b-8742-4336-a04c-2d6e830e751c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:42.031591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2aa873b-8742-4336-a04c-2d6e830e751c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:42.032473 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2aa873b-8742-4336-a04c-2d6e830e751c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:42.033361 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2aa873b-8742-4336-a04c-2d6e830e751c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:42.033918 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2aa873b-8742-4336-a04c-2d6e830e751c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:42.130163 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7bb310b9-890a-413e-8728-504dec2185cf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.958053 Jul 21 23:40:42.131928 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 133/285] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:40:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:40:42.141421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9f322817-2f54-4bb2-9c58-f1ea7c5f3285 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:42.142512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9f322817-2f54-4bb2-9c58-f1ea7c5f3285 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:42.154582 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9f322817-2f54-4bb2-9c58-f1ea7c5f3285 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:42.155691 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9f322817-2f54-4bb2-9c58-f1ea7c5f3285 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:42.157257 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9f322817-2f54-4bb2-9c58-f1ea7c5f3285 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:42.158173 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9f322817-2f54-4bb2-9c58-f1ea7c5f3285 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:42.303753 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b2aa873b-8742-4336-a04c-2d6e830e751c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:42.316316 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b2aa873b-8742-4336-a04c-2d6e830e751c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:42.319814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b2aa873b-8742-4336-a04c-2d6e830e751c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:42.321673 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b2aa873b-8742-4336-a04c-2d6e830e751c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.301988 Jul 21 23:40:42.322449 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9f322817-2f54-4bb2-9c58-f1ea7c5f3285 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188917 Jul 21 23:40:42.323044 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 134/286] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 23:40:42 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:40:42.331772 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 153/287] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:42 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:42.347609 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4bb799b4-ca31-47f1-9348-8b2df8156738 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:42.348723 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4bb799b4-ca31-47f1-9348-8b2df8156738 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:42.423253 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4bb799b4-ca31-47f1-9348-8b2df8156738 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:42.443328 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4bb799b4-ca31-47f1-9348-8b2df8156738 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1242 microversion: 2.1 time: 0.119195 Jul 21 23:40:42.443910 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 135/288] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:42 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:43.355306 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8d76c332-a32e-4dae-a87d-a263aa231fc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:43.356504 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8d76c332-a32e-4dae-a87d-a263aa231fc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:43.374508 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8d76c332-a32e-4dae-a87d-a263aa231fc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:43.375245 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8d76c332-a32e-4dae-a87d-a263aa231fc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:43.376169 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8d76c332-a32e-4dae-a87d-a263aa231fc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:43.376854 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8d76c332-a32e-4dae-a87d-a263aa231fc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:43.459908 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-868c78a1-fbec-4b10-a022-7a178b61f2c9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:43.461734 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-868c78a1-fbec-4b10-a022-7a178b61f2c9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:43.475625 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-868c78a1-fbec-4b10-a022-7a178b61f2c9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:43.476322 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-868c78a1-fbec-4b10-a022-7a178b61f2c9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:43.477875 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-868c78a1-fbec-4b10-a022-7a178b61f2c9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:43.478462 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-868c78a1-fbec-4b10-a022-7a178b61f2c9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:43.631015 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-868c78a1-fbec-4b10-a022-7a178b61f2c9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:43.647754 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-868c78a1-fbec-4b10-a022-7a178b61f2c9 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1294 microversion: 2.1 time: 0.191636 Jul 21 23:40:43.649722 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 136/289] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:43 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1294 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:40:43.696640 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8d76c332-a32e-4dae-a87d-a263aa231fc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:43.714787 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8d76c332-a32e-4dae-a87d-a263aa231fc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:43.718339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8d76c332-a32e-4dae-a87d-a263aa231fc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:43.726153 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8d76c332-a32e-4dae-a87d-a263aa231fc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.376010 Jul 21 23:40:43.727977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 154/290] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:43 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:44.202388 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-40a94409-88b0-4d12-90b4-22dc10e96b6b req-2ce23811-0bbe-47ef-b96d-8aa40ac3f29c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b1ede1-a46a-454d-9b81-5b06de1124e9", "tag": "35c14d66-0050-4ea8-b943-7e894d33c3e5"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:44.216498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-40a94409-88b0-4d12-90b4-22dc10e96b6b req-2ce23811-0bbe-47ef-b96d-8aa40ac3f29c service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:44.217874 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-40a94409-88b0-4d12-90b4-22dc10e96b6b req-2ce23811-0bbe-47ef-b96d-8aa40ac3f29c service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:44.235501 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-40a94409-88b0-4d12-90b4-22dc10e96b6b req-2ce23811-0bbe-47ef-b96d-8aa40ac3f29c service nova] Creating event network-changed:35c14d66-0050-4ea8-b943-7e894d33c3e5 for instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 on hv-cinder-85070 Jul 21 23:40:44.260073 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-40a94409-88b0-4d12-90b4-22dc10e96b6b req-2ce23811-0bbe-47ef-b96d-8aa40ac3f29c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058181 Jul 21 23:40:44.261946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 137/291] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:40:44.666041 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3e831452-5fbe-436b-bc09-38b6a035b478 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:44.666654 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3e831452-5fbe-436b-bc09-38b6a035b478 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:44.677233 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e831452-5fbe-436b-bc09-38b6a035b478 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:44.687407 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e831452-5fbe-436b-bc09-38b6a035b478 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:44.690000 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e831452-5fbe-436b-bc09-38b6a035b478 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:44.692914 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3e831452-5fbe-436b-bc09-38b6a035b478 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:44.707936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:44.752079 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7f6bd913-4e36-4afd-81a2-1b439e8822e3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:44.752830 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7f6bd913-4e36-4afd-81a2-1b439e8822e3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:44.785754 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f6bd913-4e36-4afd-81a2-1b439e8822e3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:44.786721 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f6bd913-4e36-4afd-81a2-1b439e8822e3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:44.787509 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f6bd913-4e36-4afd-81a2-1b439e8822e3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:44.787946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f6bd913-4e36-4afd-81a2-1b439e8822e3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:44.917616 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3e831452-5fbe-436b-bc09-38b6a035b478 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:44.929348 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3e831452-5fbe-436b-bc09-38b6a035b478 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1300 microversion: 2.1 time: 0.267158 Jul 21 23:40:44.933490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 155/292] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:44 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1300 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:45.343332 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7f6bd913-4e36-4afd-81a2-1b439e8822e3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:45.362417 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7f6bd913-4e36-4afd-81a2-1b439e8822e3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:45.373075 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7f6bd913-4e36-4afd-81a2-1b439e8822e3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:45.375343 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7f6bd913-4e36-4afd-81a2-1b439e8822e3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.627532 Jul 21 23:40:45.387217 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 138/293] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:44 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:45.950926 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-70c89d6e-149a-4b4d-959e-0f775506328e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:45.951537 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-70c89d6e-149a-4b4d-959e-0f775506328e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:45.978406 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70c89d6e-149a-4b4d-959e-0f775506328e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:45.978889 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70c89d6e-149a-4b4d-959e-0f775506328e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:45.981645 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70c89d6e-149a-4b4d-959e-0f775506328e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:45.982138 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70c89d6e-149a-4b4d-959e-0f775506328e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:46.298706 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-70c89d6e-149a-4b4d-959e-0f775506328e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:46.307153 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-70c89d6e-149a-4b4d-959e-0f775506328e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 0.361669 Jul 21 23:40:46.316652 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 156/294] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:45 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:46.394741 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e06e83a8-8f3c-4ff8-a500-b8db2ce841e2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:46.395346 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e06e83a8-8f3c-4ff8-a500-b8db2ce841e2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:46.403428 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e06e83a8-8f3c-4ff8-a500-b8db2ce841e2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:46.405002 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e06e83a8-8f3c-4ff8-a500-b8db2ce841e2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:46.407550 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e06e83a8-8f3c-4ff8-a500-b8db2ce841e2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:46.407987 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e06e83a8-8f3c-4ff8-a500-b8db2ce841e2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:46.648042 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e06e83a8-8f3c-4ff8-a500-b8db2ce841e2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:46.672196 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e06e83a8-8f3c-4ff8-a500-b8db2ce841e2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:46.681515 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e06e83a8-8f3c-4ff8-a500-b8db2ce841e2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:46.682984 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e06e83a8-8f3c-4ff8-a500-b8db2ce841e2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.292613 Jul 21 23:40:46.695778 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 139/295] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:46 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:47.324321 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-323b7cde-9ba7-4684-80cd-8fd833184c3c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:47.325416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-323b7cde-9ba7-4684-80cd-8fd833184c3c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:47.332082 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-323b7cde-9ba7-4684-80cd-8fd833184c3c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:47.332948 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-323b7cde-9ba7-4684-80cd-8fd833184c3c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:47.334174 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-323b7cde-9ba7-4684-80cd-8fd833184c3c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:47.334914 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-323b7cde-9ba7-4684-80cd-8fd833184c3c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:47.562191 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-323b7cde-9ba7-4684-80cd-8fd833184c3c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:47.571063 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-323b7cde-9ba7-4684-80cd-8fd833184c3c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 0.250457 Jul 21 23:40:47.584351 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 157/296] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:47 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:47.716442 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-80b9d5bd-edfc-4fe9-9a4a-30bd1cd12d62 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:47.717754 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-80b9d5bd-edfc-4fe9-9a4a-30bd1cd12d62 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:47.731597 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-80b9d5bd-edfc-4fe9-9a4a-30bd1cd12d62 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:47.732045 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-80b9d5bd-edfc-4fe9-9a4a-30bd1cd12d62 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:47.732832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-80b9d5bd-edfc-4fe9-9a4a-30bd1cd12d62 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:47.737486 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-80b9d5bd-edfc-4fe9-9a4a-30bd1cd12d62 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:47.985148 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-80b9d5bd-edfc-4fe9-9a4a-30bd1cd12d62 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:48.003346 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-80b9d5bd-edfc-4fe9-9a4a-30bd1cd12d62 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:48.005115 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-80b9d5bd-edfc-4fe9-9a4a-30bd1cd12d62 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:48.006363 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-80b9d5bd-edfc-4fe9-9a4a-30bd1cd12d62 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.304235 Jul 21 23:40:48.006916 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 140/297] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:47 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:48.589877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-53edf558-72a5-483c-a9f3-da67df6c83db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:48.596116 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-53edf558-72a5-483c-a9f3-da67df6c83db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:48.605863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53edf558-72a5-483c-a9f3-da67df6c83db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:48.606583 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53edf558-72a5-483c-a9f3-da67df6c83db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:48.607695 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53edf558-72a5-483c-a9f3-da67df6c83db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:48.608326 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53edf558-72a5-483c-a9f3-da67df6c83db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:48.716120 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f39ef17a-5f6a-4beb-8b8f-c0353bad18f3 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Action: 'create', calling method: .version_select at 0x7f7d28c7f3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1324508426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrnHbDvR80uBdlmhJfvZMv9GLsoS6d0VFi8qKEKbYSxX97fdY9JFJiTGyKslvmXNK/y7ENV/H9r+HXyAjyWslzdo2PIgvEh6ZusBZSxswcpQJIEBjh6CUfyKpcrwEfd8w=="}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:48.745279 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-f39ef17a-5f6a-4beb-8b8f-c0353bad18f3 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Getting quotas for project 235634c0fcf14ebeab084cfca36d394b. Resources: {'key_pairs'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:40:48.752046 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-f39ef17a-5f6a-4beb-8b8f-c0353bad18f3 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Getting quotas for user 33ffdc9526374a07b696f5cc59b22ef7 and project 235634c0fcf14ebeab084cfca36d394b. Resources: {'key_pairs'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:40:48.788589 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f39ef17a-5f6a-4beb-8b8f-c0353bad18f3 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.076211 Jul 21 23:40:48.790694 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 141/298] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 23:40:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:40:48.939163 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=4 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:48.950220 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1443395705", "imageRef": "d2b3620f-f5d6-4d1d-81af-87be00ad7e31", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1324508426", "networks": [{"uuid": "e0cff7d2-068a-415c-ae07-6a6f8ef7f009"}]}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:49.044174 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] validate_networks() for [('e0cff7d2-068a-415c-ae07-6a6f8ef7f009', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:40:49.083769 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-53edf558-72a5-483c-a9f3-da67df6c83db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:49.094158 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-53edf558-72a5-483c-a9f3-da67df6c83db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 0.509813 Jul 21 23:40:49.095323 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 158/299] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:48 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:49.100042 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1ba08a04-37a2-4670-b096-d4fdf027d1fd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:49.102604 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1ba08a04-37a2-4670-b096-d4fdf027d1fd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:49.110967 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ba08a04-37a2-4670-b096-d4fdf027d1fd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:49.111645 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ba08a04-37a2-4670-b096-d4fdf027d1fd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:49.112560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ba08a04-37a2-4670-b096-d4fdf027d1fd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:49.113101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1ba08a04-37a2-4670-b096-d4fdf027d1fd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:49.363457 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1ba08a04-37a2-4670-b096-d4fdf027d1fd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:49.385367 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1ba08a04-37a2-4670-b096-d4fdf027d1fd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:49.388778 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1ba08a04-37a2-4670-b096-d4fdf027d1fd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:49.393875 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1ba08a04-37a2-4670-b096-d4fdf027d1fd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.297327 Jul 21 23:40:49.394465 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 159/300] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:49 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:49.704390 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:40:49.704950 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:40:49.705554 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:40:49.706109 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:40:49.706765 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:40:49.722278 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:49.724342 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:49.726164 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:49.730591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:49.759661 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Getting quotas for project 235634c0fcf14ebeab084cfca36d394b. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:40:49.764921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Getting quotas for user 33ffdc9526374a07b696f5cc59b22ef7 and project 235634c0fcf14ebeab084cfca36d394b. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:40:49.794850 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:40:49.799596 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2b3620f-f5d6-4d1d-81af-87be00ad7e31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:40:49.832820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-46af67c6-e669-4e85-b89a-e8c59b49204a req-c5f65eff-bd19-4c7b-b10d-2605a8d792a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87a95f3-8058-423f-84d8-3bae1a4d760e", "tag": "1a6602da-da0f-4996-b2b6-eee0aef35fef"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:49.858861 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-46af67c6-e669-4e85-b89a-e8c59b49204a req-c5f65eff-bd19-4c7b-b10d-2605a8d792a2 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:49.859783 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-46af67c6-e669-4e85-b89a-e8c59b49204a req-c5f65eff-bd19-4c7b-b10d-2605a8d792a2 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:49.891313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-46af67c6-e669-4e85-b89a-e8c59b49204a req-c5f65eff-bd19-4c7b-b10d-2605a8d792a2 service nova] Creating event network-changed:1a6602da-da0f-4996-b2b6-eee0aef35fef for instance d87a95f3-8058-423f-84d8-3bae1a4d760e on hv-cinder-85070 Jul 21 23:40:49.909283 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-46af67c6-e669-4e85-b89a-e8c59b49204a req-c5f65eff-bd19-4c7b-b10d-2605a8d792a2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086178 Jul 21 23:40:49.915364 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 160/301] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:40:49.953003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bda1b140-8f26-42bc-91bf-a66de52c4533 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009679 Jul 21 23:40:49.953708 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 142/302] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:40:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:40:49.965673 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6a68433f-3bf1-46b6-860c-4d2b746d2e9f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:49.966386 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6a68433f-3bf1-46b6-860c-4d2b746d2e9f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:50.115038 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6a68433f-3bf1-46b6-860c-4d2b746d2e9f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:50.122439 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6a68433f-3bf1-46b6-860c-4d2b746d2e9f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1259 microversion: 2.1 time: 0.161483 Jul 21 23:40:50.123006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 161/303] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:49 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:50.133371 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-46bf9c40-cc55-4562-92db-fc4428a2046b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:50.133938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-46bf9c40-cc55-4562-92db-fc4428a2046b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:50.144798 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-46bf9c40-cc55-4562-92db-fc4428a2046b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:50.145117 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-46bf9c40-cc55-4562-92db-fc4428a2046b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:50.146048 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-46bf9c40-cc55-4562-92db-fc4428a2046b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:50.146501 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-46bf9c40-cc55-4562-92db-fc4428a2046b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:50.407093 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-46bf9c40-cc55-4562-92db-fc4428a2046b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:50.424201 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-46bf9c40-cc55-4562-92db-fc4428a2046b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 0.310624 Jul 21 23:40:50.424786 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 143/304] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:50 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:50.425418 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6dcd60b4-7fd3-40eb-b3d5-af4ebc89f04d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:50.426619 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6dcd60b4-7fd3-40eb-b3d5-af4ebc89f04d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:50.443939 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dcd60b4-7fd3-40eb-b3d5-af4ebc89f04d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:50.444743 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dcd60b4-7fd3-40eb-b3d5-af4ebc89f04d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:50.449511 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dcd60b4-7fd3-40eb-b3d5-af4ebc89f04d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:50.449974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dcd60b4-7fd3-40eb-b3d5-af4ebc89f04d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:50.733088 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6dcd60b4-7fd3-40eb-b3d5-af4ebc89f04d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:50.744476 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6dcd60b4-7fd3-40eb-b3d5-af4ebc89f04d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:50.746293 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6dcd60b4-7fd3-40eb-b3d5-af4ebc89f04d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:50.747784 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6dcd60b4-7fd3-40eb-b3d5-af4ebc89f04d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.336744 Jul 21 23:40:50.748875 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 162/305] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:50 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:51.138568 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-06e7cc52-9af2-47ff-8729-cfdae004572b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:51.140051 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-06e7cc52-9af2-47ff-8729-cfdae004572b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:51.149256 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-06e7cc52-9af2-47ff-8729-cfdae004572b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:51.149709 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-06e7cc52-9af2-47ff-8729-cfdae004572b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:51.150476 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-06e7cc52-9af2-47ff-8729-cfdae004572b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:51.150906 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-06e7cc52-9af2-47ff-8729-cfdae004572b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:51.219584 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-06e7cc52-9af2-47ff-8729-cfdae004572b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:51.228467 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-06e7cc52-9af2-47ff-8729-cfdae004572b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1255 microversion: 2.1 time: 0.093618 Jul 21 23:40:51.229214 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 144/306] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:51 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1255 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:51.443748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2ebcf70e-422a-4d97-b32b-39a2a0a3b7df tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:51.452625 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2ebcf70e-422a-4d97-b32b-39a2a0a3b7df tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:51.461497 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2ebcf70e-422a-4d97-b32b-39a2a0a3b7df tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:51.462316 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2ebcf70e-422a-4d97-b32b-39a2a0a3b7df tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:51.463346 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2ebcf70e-422a-4d97-b32b-39a2a0a3b7df tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:51.463984 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2ebcf70e-422a-4d97-b32b-39a2a0a3b7df tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:51.682250 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2ebcf70e-422a-4d97-b32b-39a2a0a3b7df tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:51.690196 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2ebcf70e-422a-4d97-b32b-39a2a0a3b7df tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 0.250082 Jul 21 23:40:51.690758 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 163/307] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:51 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:51.767209 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d02bde8c-a29d-4cc0-bf34-bffc325bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:51.767808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d02bde8c-a29d-4cc0-bf34-bffc325bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:51.784013 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d02bde8c-a29d-4cc0-bf34-bffc325bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:51.786602 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d02bde8c-a29d-4cc0-bf34-bffc325bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:51.788176 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d02bde8c-a29d-4cc0-bf34-bffc325bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:51.793791 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d02bde8c-a29d-4cc0-bf34-bffc325bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:52.067603 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d02bde8c-a29d-4cc0-bf34-bffc325bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:52.076454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d02bde8c-a29d-4cc0-bf34-bffc325bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:52.078227 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d02bde8c-a29d-4cc0-bf34-bffc325bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:52.079412 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d02bde8c-a29d-4cc0-bf34-bffc325bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.316102 Jul 21 23:40:52.089593 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 145/308] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:51 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:52.251049 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2c900cc9-f7e5-4330-a760-ca039650379d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:52.251616 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2c900cc9-f7e5-4330-a760-ca039650379d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:52.262576 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2c900cc9-f7e5-4330-a760-ca039650379d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:52.263023 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2c900cc9-f7e5-4330-a760-ca039650379d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:52.263812 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2c900cc9-f7e5-4330-a760-ca039650379d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:52.264245 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2c900cc9-f7e5-4330-a760-ca039650379d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:52.331949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2c900cc9-f7e5-4330-a760-ca039650379d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:52.341937 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2c900cc9-f7e5-4330-a760-ca039650379d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1311 microversion: 2.1 time: 0.100453 Jul 21 23:40:52.343668 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 164/309] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:52 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:52.722830 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-fb915b3c-c8d6-4fcd-9d49-a7d5302ab698 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:52.723949 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-fb915b3c-c8d6-4fcd-9d49-a7d5302ab698 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:52.746692 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fb915b3c-c8d6-4fcd-9d49-a7d5302ab698 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:52.747323 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fb915b3c-c8d6-4fcd-9d49-a7d5302ab698 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:52.748099 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fb915b3c-c8d6-4fcd-9d49-a7d5302ab698 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:52.749689 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fb915b3c-c8d6-4fcd-9d49-a7d5302ab698 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:53.098222 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-99c7cbe2-5db2-472a-b620-b1a0f1ea2d8c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:53.099348 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-99c7cbe2-5db2-472a-b620-b1a0f1ea2d8c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:53.106653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99c7cbe2-5db2-472a-b620-b1a0f1ea2d8c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:53.111266 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99c7cbe2-5db2-472a-b620-b1a0f1ea2d8c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:53.115344 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99c7cbe2-5db2-472a-b620-b1a0f1ea2d8c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:53.115949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-99c7cbe2-5db2-472a-b620-b1a0f1ea2d8c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:53.421430 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-99c7cbe2-5db2-472a-b620-b1a0f1ea2d8c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:53.432069 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-99c7cbe2-5db2-472a-b620-b1a0f1ea2d8c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:53.433946 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-99c7cbe2-5db2-472a-b620-b1a0f1ea2d8c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:53.435578 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-99c7cbe2-5db2-472a-b620-b1a0f1ea2d8c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.341187 Jul 21 23:40:53.448281 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 165/310] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:53 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:53.454597 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bbde20cc-99c3-425a-992a-5b161bb44770 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:53.455510 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bbde20cc-99c3-425a-992a-5b161bb44770 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:53.463782 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bbde20cc-99c3-425a-992a-5b161bb44770 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:53.464507 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bbde20cc-99c3-425a-992a-5b161bb44770 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:53.466366 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bbde20cc-99c3-425a-992a-5b161bb44770 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:53.467124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bbde20cc-99c3-425a-992a-5b161bb44770 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:53.562777 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bbde20cc-99c3-425a-992a-5b161bb44770 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:53.584475 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bbde20cc-99c3-425a-992a-5b161bb44770 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1317 microversion: 2.1 time: 0.132060 Jul 21 23:40:53.587256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 166/311] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:53 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:53.643693 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-fb915b3c-c8d6-4fcd-9d49-a7d5302ab698 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:53.659655 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-fb915b3c-c8d6-4fcd-9d49-a7d5302ab698 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 0.952055 Jul 21 23:40:53.663363 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 146/312] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:52 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:54.456439 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-20297b81-6803-422c-ad8c-2ddff7bea595 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:54.458678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-20297b81-6803-422c-ad8c-2ddff7bea595 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:54.474652 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20297b81-6803-422c-ad8c-2ddff7bea595 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:54.478729 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20297b81-6803-422c-ad8c-2ddff7bea595 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:54.484145 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20297b81-6803-422c-ad8c-2ddff7bea595 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:54.488204 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-20297b81-6803-422c-ad8c-2ddff7bea595 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:54.606414 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-fee47729-e4dd-4f56-b6ca-b4c0dc06ff1c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:54.607886 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-fee47729-e4dd-4f56-b6ca-b4c0dc06ff1c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:54.619782 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fee47729-e4dd-4f56-b6ca-b4c0dc06ff1c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:54.621029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fee47729-e4dd-4f56-b6ca-b4c0dc06ff1c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:54.622672 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fee47729-e4dd-4f56-b6ca-b4c0dc06ff1c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:54.629625 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fee47729-e4dd-4f56-b6ca-b4c0dc06ff1c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:54.697525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=100 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:55.020181 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-20297b81-6803-422c-ad8c-2ddff7bea595 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:55.033978 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-20297b81-6803-422c-ad8c-2ddff7bea595 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:55.037561 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-20297b81-6803-422c-ad8c-2ddff7bea595 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:55.042270 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-20297b81-6803-422c-ad8c-2ddff7bea595 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1743 microversion: 2.20 time: 0.590110 Jul 21 23:40:55.043988 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 167/313] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:54 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1743 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:55.052665 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-eb821a8d-0320-4025-84c1-e84d5ba7d94a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:55.057571 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-eb821a8d-0320-4025-84c1-e84d5ba7d94a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:55.091088 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eb821a8d-0320-4025-84c1-e84d5ba7d94a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:55.092915 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eb821a8d-0320-4025-84c1-e84d5ba7d94a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:55.099533 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eb821a8d-0320-4025-84c1-e84d5ba7d94a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:55.101148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eb821a8d-0320-4025-84c1-e84d5ba7d94a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:55.155505 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-fee47729-e4dd-4f56-b6ca-b4c0dc06ff1c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:55.170797 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-fee47729-e4dd-4f56-b6ca-b4c0dc06ff1c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.567975 Jul 21 23:40:55.171522 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 147/314] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:54 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:55.450292 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-eb821a8d-0320-4025-84c1-e84d5ba7d94a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:55.463538 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-eb821a8d-0320-4025-84c1-e84d5ba7d94a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 0.417537 Jul 21 23:40:55.477509 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 168/315] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:55 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:56.060719 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-871f33b6-69cb-4567-8574-e6ee3847d793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:56.061903 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-871f33b6-69cb-4567-8574-e6ee3847d793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:56.074621 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-871f33b6-69cb-4567-8574-e6ee3847d793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:56.075127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-871f33b6-69cb-4567-8574-e6ee3847d793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:56.088489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-871f33b6-69cb-4567-8574-e6ee3847d793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:56.088949 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-871f33b6-69cb-4567-8574-e6ee3847d793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:56.192095 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2d542f14-aa1d-46de-9e54-dbd3fe49b9d8 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:56.193878 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2d542f14-aa1d-46de-9e54-dbd3fe49b9d8 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:56.221837 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d542f14-aa1d-46de-9e54-dbd3fe49b9d8 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:56.223710 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d542f14-aa1d-46de-9e54-dbd3fe49b9d8 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:56.227687 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d542f14-aa1d-46de-9e54-dbd3fe49b9d8 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:56.229438 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d542f14-aa1d-46de-9e54-dbd3fe49b9d8 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:56.587830 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2d542f14-aa1d-46de-9e54-dbd3fe49b9d8 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:56.622640 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2d542f14-aa1d-46de-9e54-dbd3fe49b9d8 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.436547 Jul 21 23:40:56.624213 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 169/316] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:56 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:40:56.666416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c7d80819-cdbc-4f08-ab37-cebba6b79893 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:56.666584 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c7d80819-cdbc-4f08-ab37-cebba6b79893 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:56.675226 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7d80819-cdbc-4f08-ab37-cebba6b79893 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:56.675973 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7d80819-cdbc-4f08-ab37-cebba6b79893 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:56.678198 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7d80819-cdbc-4f08-ab37-cebba6b79893 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:56.678858 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7d80819-cdbc-4f08-ab37-cebba6b79893 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:56.993941 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-871f33b6-69cb-4567-8574-e6ee3847d793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:57.020527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-871f33b6-69cb-4567-8574-e6ee3847d793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:57.024244 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-871f33b6-69cb-4567-8574-e6ee3847d793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:57.027303 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-871f33b6-69cb-4567-8574-e6ee3847d793 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1743 microversion: 2.20 time: 0.970268 Jul 21 23:40:57.028195 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 148/317] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:56 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1743 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:57.638549 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c7d80819-cdbc-4f08-ab37-cebba6b79893 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:57.644034 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6c48cf6a-27d6-4dfb-af55-efa6e8c77d0e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:57.644688 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6c48cf6a-27d6-4dfb-af55-efa6e8c77d0e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:57.664729 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c7d80819-cdbc-4f08-ab37-cebba6b79893 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 1.038245 Jul 21 23:40:57.666814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 170/318] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:56 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:57.683485 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6c48cf6a-27d6-4dfb-af55-efa6e8c77d0e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:57.691982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6c48cf6a-27d6-4dfb-af55-efa6e8c77d0e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:57.694147 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6c48cf6a-27d6-4dfb-af55-efa6e8c77d0e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:57.696611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6c48cf6a-27d6-4dfb-af55-efa6e8c77d0e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:58.047468 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7d646292-4fca-4feb-9492-f97fc549e35b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:58.048349 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7d646292-4fca-4feb-9492-f97fc549e35b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:58.085353 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d646292-4fca-4feb-9492-f97fc549e35b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:58.089541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d646292-4fca-4feb-9492-f97fc549e35b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:58.090449 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d646292-4fca-4feb-9492-f97fc549e35b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:58.091184 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7d646292-4fca-4feb-9492-f97fc549e35b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:58.532190 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7d646292-4fca-4feb-9492-f97fc549e35b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:58.567122 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7d646292-4fca-4feb-9492-f97fc549e35b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:58.585025 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7d646292-4fca-4feb-9492-f97fc549e35b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:58.586934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7d646292-4fca-4feb-9492-f97fc549e35b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1743 microversion: 2.20 time: 0.544417 Jul 21 23:40:58.608076 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 171/319] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:58 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1743 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:40:58.692219 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2a3a2ba5-b01e-4897-a824-7b26e652e195 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:58.692880 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2a3a2ba5-b01e-4897-a824-7b26e652e195 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:58.755027 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a3a2ba5-b01e-4897-a824-7b26e652e195 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:58.755829 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a3a2ba5-b01e-4897-a824-7b26e652e195 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:58.757034 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a3a2ba5-b01e-4897-a824-7b26e652e195 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:58.757832 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2a3a2ba5-b01e-4897-a824-7b26e652e195 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:59.172667 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2a3a2ba5-b01e-4897-a824-7b26e652e195 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:59.204922 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2a3a2ba5-b01e-4897-a824-7b26e652e195 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 0.502992 Jul 21 23:40:59.207067 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 172/320] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:58 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:40:59.626625 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ebff7148-b12a-4851-a595-16e088a5eb90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:40:59.627456 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ebff7148-b12a-4851-a595-16e088a5eb90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:40:59.641431 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebff7148-b12a-4851-a595-16e088a5eb90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:59.642486 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebff7148-b12a-4851-a595-16e088a5eb90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:59.644373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebff7148-b12a-4851-a595-16e088a5eb90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:59.659246 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ebff7148-b12a-4851-a595-16e088a5eb90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:59.695224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:59.746187 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=4 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:59.780288 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=18 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:59.799121 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6c48cf6a-27d6-4dfb-af55-efa6e8c77d0e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:40:59.810410 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6c48cf6a-27d6-4dfb-af55-efa6e8c77d0e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 2.170070 Jul 21 23:40:59.817297 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 149/321] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:40:57 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:40:59.866777 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-ada7be62-42e0-4d3d-8152-0b78c05a4095 req-ea712bb3-333e-477e-9f95-af44123a44df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5fa3e4-c19a-40ef-8cec-92cd819d132f", "tag": "3d912156-66c3-4060-a4b0-45f5c1b2da29"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:40:59.895555 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-ada7be62-42e0-4d3d-8152-0b78c05a4095 req-ea712bb3-333e-477e-9f95-af44123a44df service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:40:59.898552 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-ada7be62-42e0-4d3d-8152-0b78c05a4095 req-ea712bb3-333e-477e-9f95-af44123a44df service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:40:59.957527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-ada7be62-42e0-4d3d-8152-0b78c05a4095 req-ea712bb3-333e-477e-9f95-af44123a44df service nova] Creating event network-changed:3d912156-66c3-4060-a4b0-45f5c1b2da29 for instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f on hv-cinder-85070 Jul 21 23:40:59.969040 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-ada7be62-42e0-4d3d-8152-0b78c05a4095 req-ea712bb3-333e-477e-9f95-af44123a44df service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107047 Jul 21 23:40:59.973894 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 150/322] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:00.122372 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:00.189569 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ebff7148-b12a-4851-a595-16e088a5eb90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:00.200417 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ebff7148-b12a-4851-a595-16e088a5eb90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:00.204868 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ebff7148-b12a-4851-a595-16e088a5eb90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:00.207896 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ebff7148-b12a-4851-a595-16e088a5eb90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1738 microversion: 2.20 time: 0.585880 Jul 21 23:41:00.229825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 173/323] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:40:59 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1738 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:00.233485 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3a5cb3f6-b7fe-4a36-8322-572f845a03bc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:00.234243 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3a5cb3f6-b7fe-4a36-8322-572f845a03bc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:00.243826 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3a5cb3f6-b7fe-4a36-8322-572f845a03bc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:00.244279 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3a5cb3f6-b7fe-4a36-8322-572f845a03bc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:00.248846 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3a5cb3f6-b7fe-4a36-8322-572f845a03bc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:00.249355 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3a5cb3f6-b7fe-4a36-8322-572f845a03bc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:00.493891 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-dbc7c2a2-1d68-4234-8b61-7aa72351f50d req-f266f9ca-1f6d-4a27-b96c-3023ab24c180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87a95f3-8058-423f-84d8-3bae1a4d760e", "name": "network-vif-plugged", "status": "completed", "tag": "1a6602da-da0f-4996-b2b6-eee0aef35fef"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:00.509010 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-dbc7c2a2-1d68-4234-8b61-7aa72351f50d req-f266f9ca-1f6d-4a27-b96c-3023ab24c180 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:00.509488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-dbc7c2a2-1d68-4234-8b61-7aa72351f50d req-f266f9ca-1f6d-4a27-b96c-3023ab24c180 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:00.540424 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-dbc7c2a2-1d68-4234-8b61-7aa72351f50d req-f266f9ca-1f6d-4a27-b96c-3023ab24c180 service nova] Creating event network-vif-plugged:1a6602da-da0f-4996-b2b6-eee0aef35fef for instance d87a95f3-8058-423f-84d8-3bae1a4d760e on hv-cinder-85070 Jul 21 23:41:00.545895 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-dbc7c2a2-1d68-4234-8b61-7aa72351f50d req-f266f9ca-1f6d-4a27-b96c-3023ab24c180 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056329 Jul 21 23:41:00.546504 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 174/324] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:41:00.834815 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8f7801d1-1701-41d3-9bd3-a729e59bca98 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:00.837301 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8f7801d1-1701-41d3-9bd3-a729e59bca98 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:00.862528 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f7801d1-1701-41d3-9bd3-a729e59bca98 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:00.863449 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f7801d1-1701-41d3-9bd3-a729e59bca98 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:00.864670 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f7801d1-1701-41d3-9bd3-a729e59bca98 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:00.865297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f7801d1-1701-41d3-9bd3-a729e59bca98 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:01.158214 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8f7801d1-1701-41d3-9bd3-a729e59bca98 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:01.169477 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8f7801d1-1701-41d3-9bd3-a729e59bca98 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.339528 Jul 21 23:41:01.177468 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3a5cb3f6-b7fe-4a36-8322-572f845a03bc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:01.181726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 175/325] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:00 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:01.187755 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3a5cb3f6-b7fe-4a36-8322-572f845a03bc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 0.966890 Jul 21 23:41:01.198922 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 151/326] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:00 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:01.236630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-004a5ed0-7414-41c5-b6a7-30159104cffe tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:01.237676 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-004a5ed0-7414-41c5-b6a7-30159104cffe tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:01.249358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-004a5ed0-7414-41c5-b6a7-30159104cffe tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:01.250740 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-004a5ed0-7414-41c5-b6a7-30159104cffe tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:01.251902 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-004a5ed0-7414-41c5-b6a7-30159104cffe tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:01.254575 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-004a5ed0-7414-41c5-b6a7-30159104cffe tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:01.603314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-004a5ed0-7414-41c5-b6a7-30159104cffe tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:01.618695 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-004a5ed0-7414-41c5-b6a7-30159104cffe tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:01.620829 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-004a5ed0-7414-41c5-b6a7-30159104cffe tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:01.624581 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-004a5ed0-7414-41c5-b6a7-30159104cffe tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1738 microversion: 2.20 time: 0.392057 Jul 21 23:41:01.639038 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 176/327] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:01 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1738 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:02.190479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e2ba7da9-9e13-4524-9b8e-1df1a0174e67 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:02.191206 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e2ba7da9-9e13-4524-9b8e-1df1a0174e67 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:02.201478 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e2ba7da9-9e13-4524-9b8e-1df1a0174e67 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:02.202303 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e2ba7da9-9e13-4524-9b8e-1df1a0174e67 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:02.204492 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e2ba7da9-9e13-4524-9b8e-1df1a0174e67 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:02.211939 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e2ba7da9-9e13-4524-9b8e-1df1a0174e67 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:02.214795 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ccf7bc6b-1f25-4d86-9cca-16a7a9f18e73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:02.216036 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ccf7bc6b-1f25-4d86-9cca-16a7a9f18e73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:02.230274 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ccf7bc6b-1f25-4d86-9cca-16a7a9f18e73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:02.231121 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ccf7bc6b-1f25-4d86-9cca-16a7a9f18e73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:02.234484 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ccf7bc6b-1f25-4d86-9cca-16a7a9f18e73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:02.242022 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ccf7bc6b-1f25-4d86-9cca-16a7a9f18e73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:02.610309 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ccf7bc6b-1f25-4d86-9cca-16a7a9f18e73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:02.626115 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ccf7bc6b-1f25-4d86-9cca-16a7a9f18e73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 0.415624 Jul 21 23:41:02.641906 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 177/328] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:02 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:02.649746 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-e1538b31-322f-42ac-b949-1d0e99dc7a57 req-3411d68b-8687-4cb3-a13a-77bce15ba699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1e0d18-427a-456e-8ca0-c246e41f1fab", "name": "network-vif-plugged", "status": "completed", "tag": "7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:02.674995 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e1538b31-322f-42ac-b949-1d0e99dc7a57 req-3411d68b-8687-4cb3-a13a-77bce15ba699 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:02.675739 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e1538b31-322f-42ac-b949-1d0e99dc7a57 req-3411d68b-8687-4cb3-a13a-77bce15ba699 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:02.691992 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-e1538b31-322f-42ac-b949-1d0e99dc7a57 req-3411d68b-8687-4cb3-a13a-77bce15ba699 service nova] Creating event network-vif-plugged:7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8 for instance eb1e0d18-427a-456e-8ca0-c246e41f1fab on hv-cinder-85070 Jul 21 23:41:02.698898 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-e1538b31-322f-42ac-b949-1d0e99dc7a57 req-3411d68b-8687-4cb3-a13a-77bce15ba699 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054717 Jul 21 23:41:02.699821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 178/329] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:02.706994 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-052a2d33-b1f2-434f-be51-08d935d3e2c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:02.708161 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-052a2d33-b1f2-434f-be51-08d935d3e2c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:02.715819 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-052a2d33-b1f2-434f-be51-08d935d3e2c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:02.716624 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-052a2d33-b1f2-434f-be51-08d935d3e2c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:02.718239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-052a2d33-b1f2-434f-be51-08d935d3e2c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:02.718904 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-052a2d33-b1f2-434f-be51-08d935d3e2c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:02.898875 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e2ba7da9-9e13-4524-9b8e-1df1a0174e67 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:02.907178 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e2ba7da9-9e13-4524-9b8e-1df1a0174e67 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.723036 Jul 21 23:41:02.926878 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 152/330] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:02 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:02.952176 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-052a2d33-b1f2-434f-be51-08d935d3e2c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:02.972695 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-052a2d33-b1f2-434f-be51-08d935d3e2c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:02.978479 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-052a2d33-b1f2-434f-be51-08d935d3e2c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:02.983222 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-052a2d33-b1f2-434f-be51-08d935d3e2c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1738 microversion: 2.20 time: 0.279840 Jul 21 23:41:02.984493 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 179/331] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:02 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:03.643974 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4e30cea7-4675-4f00-b9c1-6071e6dec22f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:03.645478 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4e30cea7-4675-4f00-b9c1-6071e6dec22f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:03.648951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:03.663834 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4e30cea7-4675-4f00-b9c1-6071e6dec22f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:03.664753 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4e30cea7-4675-4f00-b9c1-6071e6dec22f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:03.665838 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4e30cea7-4675-4f00-b9c1-6071e6dec22f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:03.666515 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4e30cea7-4675-4f00-b9c1-6071e6dec22f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:03.924322 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0d01e7a5-97f0-4c59-9b80-e1d2885658d5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:03.925656 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0d01e7a5-97f0-4c59-9b80-e1d2885658d5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:03.935050 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d01e7a5-97f0-4c59-9b80-e1d2885658d5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:03.941912 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d01e7a5-97f0-4c59-9b80-e1d2885658d5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:03.943024 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d01e7a5-97f0-4c59-9b80-e1d2885658d5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:03.949072 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d01e7a5-97f0-4c59-9b80-e1d2885658d5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:04.326038 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0d01e7a5-97f0-4c59-9b80-e1d2885658d5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:04.336141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0d01e7a5-97f0-4c59-9b80-e1d2885658d5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.415069 Jul 21 23:41:04.337366 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 180/332] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:03 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:04.342785 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7ce909d8-30c9-40c2-9122-25bf1a9fcd2f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:04.343589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7ce909d8-30c9-40c2-9122-25bf1a9fcd2f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:04.355200 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ce909d8-30c9-40c2-9122-25bf1a9fcd2f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:04.355917 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ce909d8-30c9-40c2-9122-25bf1a9fcd2f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:04.356852 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ce909d8-30c9-40c2-9122-25bf1a9fcd2f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:04.357478 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ce909d8-30c9-40c2-9122-25bf1a9fcd2f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:04.603252 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4e30cea7-4675-4f00-b9c1-6071e6dec22f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:04.614228 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4e30cea7-4675-4f00-b9c1-6071e6dec22f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1367 microversion: 2.1 time: 0.974074 Jul 21 23:41:04.617872 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 153/333] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:03 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1367 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:04.704806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7ce909d8-30c9-40c2-9122-25bf1a9fcd2f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:04.714997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7ce909d8-30c9-40c2-9122-25bf1a9fcd2f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:04.719448 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7ce909d8-30c9-40c2-9122-25bf1a9fcd2f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:04.724119 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7ce909d8-30c9-40c2-9122-25bf1a9fcd2f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1738 microversion: 2.20 time: 0.385519 Jul 21 23:41:04.724701 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 181/334] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:04 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1738 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:05.355274 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bcc3c91e-6d83-4d53-a562-e17cf8a28157 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:05.356019 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bcc3c91e-6d83-4d53-a562-e17cf8a28157 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:05.374973 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bcc3c91e-6d83-4d53-a562-e17cf8a28157 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:05.375535 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bcc3c91e-6d83-4d53-a562-e17cf8a28157 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:05.384791 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bcc3c91e-6d83-4d53-a562-e17cf8a28157 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:05.386479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bcc3c91e-6d83-4d53-a562-e17cf8a28157 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:05.637941 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d3388725-4795-4abc-a3f8-2246b2d36420 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:05.638679 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d3388725-4795-4abc-a3f8-2246b2d36420 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:05.641314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:05.664782 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d3388725-4795-4abc-a3f8-2246b2d36420 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:05.665678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d3388725-4795-4abc-a3f8-2246b2d36420 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:05.666724 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d3388725-4795-4abc-a3f8-2246b2d36420 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:05.667424 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d3388725-4795-4abc-a3f8-2246b2d36420 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:05.954123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d3388725-4795-4abc-a3f8-2246b2d36420 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:05.974492 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d3388725-4795-4abc-a3f8-2246b2d36420 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1557 microversion: 2.1 time: 0.343329 Jul 21 23:41:05.976813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 182/335] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:05 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1557 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:05.981947 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5b60bb95-529d-4226-9fbf-60b95dc51799 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:05.982696 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5b60bb95-529d-4226-9fbf-60b95dc51799 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:05.997512 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5b60bb95-529d-4226-9fbf-60b95dc51799 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:05.998333 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5b60bb95-529d-4226-9fbf-60b95dc51799 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:05.999385 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5b60bb95-529d-4226-9fbf-60b95dc51799 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:06.000478 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5b60bb95-529d-4226-9fbf-60b95dc51799 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:06.320169 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bcc3c91e-6d83-4d53-a562-e17cf8a28157 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:06.330867 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bcc3c91e-6d83-4d53-a562-e17cf8a28157 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.981707 Jul 21 23:41:06.341156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5b60bb95-529d-4226-9fbf-60b95dc51799 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:06.343986 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 154/336] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:05 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:06.354252 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5b60bb95-529d-4226-9fbf-60b95dc51799 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:06.356923 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5b60bb95-529d-4226-9fbf-60b95dc51799 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:06.358394 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5b60bb95-529d-4226-9fbf-60b95dc51799 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1738 microversion: 2.20 time: 0.380469 Jul 21 23:41:06.359419 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 183/337] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:05 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1738 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:06.362346 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9e78fadc-9eb8-490c-943e-cb8515915032 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:06.366082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9e78fadc-9eb8-490c-943e-cb8515915032 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:06.387362 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9e78fadc-9eb8-490c-943e-cb8515915032 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:06.387965 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9e78fadc-9eb8-490c-943e-cb8515915032 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:06.388867 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9e78fadc-9eb8-490c-943e-cb8515915032 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:06.396906 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9e78fadc-9eb8-490c-943e-cb8515915032 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:06.603057 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9e78fadc-9eb8-490c-943e-cb8515915032 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.257512 Jul 21 23:41:06.603757 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 155/338] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 23:41:06 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:07.351626 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fbb0a178-8b06-41f6-a2a2-836c986bbdbb tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:07.352478 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fbb0a178-8b06-41f6-a2a2-836c986bbdbb tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:07.375637 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbb0a178-8b06-41f6-a2a2-836c986bbdbb tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:07.376259 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbb0a178-8b06-41f6-a2a2-836c986bbdbb tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:07.377392 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbb0a178-8b06-41f6-a2a2-836c986bbdbb tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:07.377992 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-99fdb28e-bfc2-4977-b47c-629c837a27e9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:07.378593 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-99fdb28e-bfc2-4977-b47c-629c837a27e9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:07.379136 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fbb0a178-8b06-41f6-a2a2-836c986bbdbb tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:07.394734 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-99fdb28e-bfc2-4977-b47c-629c837a27e9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:07.398411 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-99fdb28e-bfc2-4977-b47c-629c837a27e9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:07.399496 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-99fdb28e-bfc2-4977-b47c-629c837a27e9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:07.401755 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-99fdb28e-bfc2-4977-b47c-629c837a27e9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:07.700900 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-fbb0a178-8b06-41f6-a2a2-836c986bbdbb tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:07.719705 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fbb0a178-8b06-41f6-a2a2-836c986bbdbb tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.372429 Jul 21 23:41:07.720753 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 184/339] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:07 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:08.119551 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-99fdb28e-bfc2-4977-b47c-629c837a27e9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:08.172619 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-99fdb28e-bfc2-4977-b47c-629c837a27e9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:08.176497 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-99fdb28e-bfc2-4977-b47c-629c837a27e9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:08.184377 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-99fdb28e-bfc2-4977-b47c-629c837a27e9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1738 microversion: 2.20 time: 0.806645 Jul 21 23:41:08.202710 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 156/340] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:07 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1738 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:08.737939 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-edd81f30-3b74-4a48-b045-bb04aeed17f6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:08.739469 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-edd81f30-3b74-4a48-b045-bb04aeed17f6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:08.752887 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-edd81f30-3b74-4a48-b045-bb04aeed17f6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:08.755244 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-edd81f30-3b74-4a48-b045-bb04aeed17f6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:08.756236 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-edd81f30-3b74-4a48-b045-bb04aeed17f6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:08.758331 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-edd81f30-3b74-4a48-b045-bb04aeed17f6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:08.885174 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-63e07b16-2203-486e-80e7-cad796c3cc23 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Action: 'create', calling method: .version_select at 0x7f7d28c2da60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1308624493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzsTy07I2A1DT7KgUxU2hPujPA8owwLWE/xsmbTwBuGW/Yytn/8xdb/obY3OxUVoiuLkVh3QIbU08ne6j+TuvEOadDWK0vZPR1QHg9iDXnTYFbNg+f/JOroFH0e5BR5Dg=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:08.955726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-63e07b16-2203-486e-80e7-cad796c3cc23 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Getting quotas for project 44fb74dd337c49a898397e3482e4305d. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:41:08.971086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-63e07b16-2203-486e-80e7-cad796c3cc23 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Getting quotas for user 26738ea4f6d54d7d81f1ec5057c237ff and project 44fb74dd337c49a898397e3482e4305d. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:41:09.094349 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-63e07b16-2203-486e-80e7-cad796c3cc23 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.622613 Jul 21 23:41:09.095340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 185/341] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 23:41:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:09.181607 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-edd81f30-3b74-4a48-b045-bb04aeed17f6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:09.192579 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-edd81f30-3b74-4a48-b045-bb04aeed17f6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.458668 Jul 21 23:41:09.214232 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 157/342] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:08 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:09.218984 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-864c2ddb-b0e9-4c88-8270-0e31a3c89574 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:09.220524 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-864c2ddb-b0e9-4c88-8270-0e31a3c89574 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:09.236548 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-864c2ddb-b0e9-4c88-8270-0e31a3c89574 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:09.237107 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-864c2ddb-b0e9-4c88-8270-0e31a3c89574 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:09.237980 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-864c2ddb-b0e9-4c88-8270-0e31a3c89574 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:09.239689 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-864c2ddb-b0e9-4c88-8270-0e31a3c89574 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:09.317213 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-310ebdd3-5069-401b-b8e2-4850a150f1cb req-961e707e-5faa-4680-9459-4941fdf9c833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87a95f3-8058-423f-84d8-3bae1a4d760e", "tag": "1a6602da-da0f-4996-b2b6-eee0aef35fef"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:09.347265 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-310ebdd3-5069-401b-b8e2-4850a150f1cb req-961e707e-5faa-4680-9459-4941fdf9c833 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:09.348099 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-310ebdd3-5069-401b-b8e2-4850a150f1cb req-961e707e-5faa-4680-9459-4941fdf9c833 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:09.374767 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-310ebdd3-5069-401b-b8e2-4850a150f1cb req-961e707e-5faa-4680-9459-4941fdf9c833 service nova] Creating event network-changed:1a6602da-da0f-4996-b2b6-eee0aef35fef for instance d87a95f3-8058-423f-84d8-3bae1a4d760e on hv-cinder-85070 Jul 21 23:41:09.383380 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-310ebdd3-5069-401b-b8e2-4850a150f1cb req-961e707e-5faa-4680-9459-4941fdf9c833 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070964 Jul 21 23:41:09.394009 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 158/343] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:41:09.622290 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-864c2ddb-b0e9-4c88-8270-0e31a3c89574 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:09.640007 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-864c2ddb-b0e9-4c88-8270-0e31a3c89574 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:09.642010 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-864c2ddb-b0e9-4c88-8270-0e31a3c89574 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:09.645238 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-864c2ddb-b0e9-4c88-8270-0e31a3c89574 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1738 microversion: 2.20 time: 0.439405 Jul 21 23:41:09.657150 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 186/344] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:09 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1738 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:10.223590 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9abe8b07-1e01-4172-8633-dfe9db83ea13 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:10.225160 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9abe8b07-1e01-4172-8633-dfe9db83ea13 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:10.241238 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9abe8b07-1e01-4172-8633-dfe9db83ea13 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:10.244309 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9abe8b07-1e01-4172-8633-dfe9db83ea13 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:10.246784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9abe8b07-1e01-4172-8633-dfe9db83ea13 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:10.247431 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9abe8b07-1e01-4172-8633-dfe9db83ea13 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:10.665472 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0b601b89-b4ce-4495-a734-d1649d900622 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:10.666760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0b601b89-b4ce-4495-a734-d1649d900622 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:10.675078 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b601b89-b4ce-4495-a734-d1649d900622 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:10.676075 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b601b89-b4ce-4495-a734-d1649d900622 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:10.677119 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b601b89-b4ce-4495-a734-d1649d900622 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:10.677776 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b601b89-b4ce-4495-a734-d1649d900622 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:10.696571 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9abe8b07-1e01-4172-8633-dfe9db83ea13 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:10.705408 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9abe8b07-1e01-4172-8633-dfe9db83ea13 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.486920 Jul 21 23:41:10.710238 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 159/345] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:10 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:10.941245 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0b601b89-b4ce-4495-a734-d1649d900622 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:10.954273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0b601b89-b4ce-4495-a734-d1649d900622 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:10.958267 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0b601b89-b4ce-4495-a734-d1649d900622 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:10.960839 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0b601b89-b4ce-4495-a734-d1649d900622 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1738 microversion: 2.20 time: 0.299749 Jul 21 23:41:10.965437 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 187/346] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:10 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:11.732507 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1f3e5e6d-0de0-4f9a-8739-ce91cfcbe360 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:11.734847 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1f3e5e6d-0de0-4f9a-8739-ce91cfcbe360 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:11.748349 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1f3e5e6d-0de0-4f9a-8739-ce91cfcbe360 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:11.749056 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1f3e5e6d-0de0-4f9a-8739-ce91cfcbe360 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:11.750128 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1f3e5e6d-0de0-4f9a-8739-ce91cfcbe360 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:11.751152 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1f3e5e6d-0de0-4f9a-8739-ce91cfcbe360 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:11.985751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6508466b-8f5b-466b-9724-a348c774f908 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:11.986540 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6508466b-8f5b-466b-9724-a348c774f908 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:12.002060 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6508466b-8f5b-466b-9724-a348c774f908 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:12.002879 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6508466b-8f5b-466b-9724-a348c774f908 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:12.008272 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6508466b-8f5b-466b-9724-a348c774f908 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:12.010783 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6508466b-8f5b-466b-9724-a348c774f908 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:12.145751 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1f3e5e6d-0de0-4f9a-8739-ce91cfcbe360 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:12.162252 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1f3e5e6d-0de0-4f9a-8739-ce91cfcbe360 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.438462 Jul 21 23:41:12.173792 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 160/347] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:11 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:12.306661 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6508466b-8f5b-466b-9724-a348c774f908 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:12.317465 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6508466b-8f5b-466b-9724-a348c774f908 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:12.321275 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6508466b-8f5b-466b-9724-a348c774f908 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:12.323930 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6508466b-8f5b-466b-9724-a348c774f908 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1738 microversion: 2.20 time: 0.343901 Jul 21 23:41:12.327977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 188/348] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:11 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:13.181218 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-93636724-0e9c-46f5-b18a-f9717dfa71ae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:13.184192 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-93636724-0e9c-46f5-b18a-f9717dfa71ae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:13.195374 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-93636724-0e9c-46f5-b18a-f9717dfa71ae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:13.195922 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-93636724-0e9c-46f5-b18a-f9717dfa71ae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:13.196701 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-93636724-0e9c-46f5-b18a-f9717dfa71ae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:13.197133 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-93636724-0e9c-46f5-b18a-f9717dfa71ae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:13.348933 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ba57b124-2bb0-4965-b975-b0bdf15ee9cf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:13.349577 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ba57b124-2bb0-4965-b975-b0bdf15ee9cf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:13.366696 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba57b124-2bb0-4965-b975-b0bdf15ee9cf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:13.373041 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba57b124-2bb0-4965-b975-b0bdf15ee9cf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:13.374118 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba57b124-2bb0-4965-b975-b0bdf15ee9cf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:13.374808 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba57b124-2bb0-4965-b975-b0bdf15ee9cf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:13.620438 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ba57b124-2bb0-4965-b975-b0bdf15ee9cf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:13.652550 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ba57b124-2bb0-4965-b975-b0bdf15ee9cf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:13.662816 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ba57b124-2bb0-4965-b975-b0bdf15ee9cf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:13.666687 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ba57b124-2bb0-4965-b975-b0bdf15ee9cf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1738 microversion: 2.20 time: 0.324702 Jul 21 23:41:13.669981 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 189/349] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:13 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:13.689156 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-93636724-0e9c-46f5-b18a-f9717dfa71ae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:13.697951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-93636724-0e9c-46f5-b18a-f9717dfa71ae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.521915 Jul 21 23:41:13.709697 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 161/350] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:13 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:14.686899 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b7bf5ff7-3268-48d5-95c1-948dbcbab937 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:14.688140 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b7bf5ff7-3268-48d5-95c1-948dbcbab937 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:14.695062 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7bf5ff7-3268-48d5-95c1-948dbcbab937 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:14.695858 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7bf5ff7-3268-48d5-95c1-948dbcbab937 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:14.696863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7bf5ff7-3268-48d5-95c1-948dbcbab937 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:14.697554 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b7bf5ff7-3268-48d5-95c1-948dbcbab937 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:14.719908 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-40ee13d4-c736-43ac-9030-c696aee7999a tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:14.720498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-40ee13d4-c736-43ac-9030-c696aee7999a tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:14.728211 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-40ee13d4-c736-43ac-9030-c696aee7999a tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:14.729028 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-40ee13d4-c736-43ac-9030-c696aee7999a tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:14.730101 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-40ee13d4-c736-43ac-9030-c696aee7999a tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:14.730801 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-40ee13d4-c736-43ac-9030-c696aee7999a tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:14.869840 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b7bf5ff7-3268-48d5-95c1-948dbcbab937 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:14.882758 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b7bf5ff7-3268-48d5-95c1-948dbcbab937 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:14.890046 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b7bf5ff7-3268-48d5-95c1-948dbcbab937 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:14.891583 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b7bf5ff7-3268-48d5-95c1-948dbcbab937 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1738 microversion: 2.20 time: 0.209129 Jul 21 23:41:14.892926 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 190/351] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:14 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:14.952783 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-40ee13d4-c736-43ac-9030-c696aee7999a tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:14.958566 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-40ee13d4-c736-43ac-9030-c696aee7999a tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.242602 Jul 21 23:41:14.959154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 162/352] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:14 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:15.910744 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7dfff59f-105d-4a8e-bf3d-9ea1e1f7638b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:15.911381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7dfff59f-105d-4a8e-bf3d-9ea1e1f7638b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:15.918395 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7dfff59f-105d-4a8e-bf3d-9ea1e1f7638b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:15.918991 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7dfff59f-105d-4a8e-bf3d-9ea1e1f7638b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:15.920048 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7dfff59f-105d-4a8e-bf3d-9ea1e1f7638b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:15.920529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7dfff59f-105d-4a8e-bf3d-9ea1e1f7638b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:15.976802 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-06094c4f-ab1b-4415-8db4-7cc89843b2fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:15.977453 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-06094c4f-ab1b-4415-8db4-7cc89843b2fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:15.984188 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-06094c4f-ab1b-4415-8db4-7cc89843b2fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:15.984644 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-06094c4f-ab1b-4415-8db4-7cc89843b2fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:15.985458 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-06094c4f-ab1b-4415-8db4-7cc89843b2fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:15.985896 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-06094c4f-ab1b-4415-8db4-7cc89843b2fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:16.075488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7dfff59f-105d-4a8e-bf3d-9ea1e1f7638b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:16.084552 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7dfff59f-105d-4a8e-bf3d-9ea1e1f7638b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:16.086771 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7dfff59f-105d-4a8e-bf3d-9ea1e1f7638b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:16.087987 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7dfff59f-105d-4a8e-bf3d-9ea1e1f7638b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1720 microversion: 2.20 time: 0.181203 Jul 21 23:41:16.088546 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 191/353] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:15 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:16.417144 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-06094c4f-ab1b-4415-8db4-7cc89843b2fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:16.426564 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-06094c4f-ab1b-4415-8db4-7cc89843b2fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.453696 Jul 21 23:41:16.427370 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 163/354] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:15 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:17.114931 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2d5bb896-eedd-4a79-8f71-32c90b5bccd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:17.115308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2d5bb896-eedd-4a79-8f71-32c90b5bccd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:17.148256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d5bb896-eedd-4a79-8f71-32c90b5bccd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:17.148758 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d5bb896-eedd-4a79-8f71-32c90b5bccd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:17.149676 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d5bb896-eedd-4a79-8f71-32c90b5bccd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:17.150171 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2d5bb896-eedd-4a79-8f71-32c90b5bccd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:17.171470 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:17.303004 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2d5bb896-eedd-4a79-8f71-32c90b5bccd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:17.313534 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2d5bb896-eedd-4a79-8f71-32c90b5bccd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:17.315113 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2d5bb896-eedd-4a79-8f71-32c90b5bccd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:17.316279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2d5bb896-eedd-4a79-8f71-32c90b5bccd8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1720 microversion: 2.20 time: 0.213124 Jul 21 23:41:17.316843 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 192/355] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:17 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1720 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:17.442858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8365cb4e-2530-4697-a378-915b26d4b178 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:17.443490 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8365cb4e-2530-4697-a378-915b26d4b178 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:17.449918 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8365cb4e-2530-4697-a378-915b26d4b178 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:17.450368 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8365cb4e-2530-4697-a378-915b26d4b178 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:17.451127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8365cb4e-2530-4697-a378-915b26d4b178 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:17.451563 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8365cb4e-2530-4697-a378-915b26d4b178 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:17.588302 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-8365cb4e-2530-4697-a378-915b26d4b178 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:17.595948 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8365cb4e-2530-4697-a378-915b26d4b178 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.156966 Jul 21 23:41:17.596512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 164/356] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:17 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:18.335643 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-37ba1218-6feb-46e9-b8f3-639ed6982621 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:18.336355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-37ba1218-6feb-46e9-b8f3-639ed6982621 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:18.342864 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37ba1218-6feb-46e9-b8f3-639ed6982621 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:18.343303 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37ba1218-6feb-46e9-b8f3-639ed6982621 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:18.344052 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37ba1218-6feb-46e9-b8f3-639ed6982621 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:18.344517 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37ba1218-6feb-46e9-b8f3-639ed6982621 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:18.488101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-37ba1218-6feb-46e9-b8f3-639ed6982621 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:18.496854 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-37ba1218-6feb-46e9-b8f3-639ed6982621 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:18.498372 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-37ba1218-6feb-46e9-b8f3-639ed6982621 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:18.499503 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-37ba1218-6feb-46e9-b8f3-639ed6982621 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1720 microversion: 2.20 time: 0.167835 Jul 21 23:41:18.500061 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 193/357] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:18 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:18.612125 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-98d730c8-ac97-499f-842a-af7c20f6c37b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:18.612719 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-98d730c8-ac97-499f-842a-af7c20f6c37b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:18.619794 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-98d730c8-ac97-499f-842a-af7c20f6c37b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:18.620498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-98d730c8-ac97-499f-842a-af7c20f6c37b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:18.621330 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-98d730c8-ac97-499f-842a-af7c20f6c37b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:18.621819 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-98d730c8-ac97-499f-842a-af7c20f6c37b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:18.642267 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=100 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:18.769580 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-98d730c8-ac97-499f-842a-af7c20f6c37b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:18.777605 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-98d730c8-ac97-499f-842a-af7c20f6c37b tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.169271 Jul 21 23:41:18.778181 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 165/358] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:18 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:19.210133 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-36914168-cf8e-48d0-b75d-942ef62d857f req-bccb1732-b2b5-4303-80b6-cb8204ef759b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5fa3e4-c19a-40ef-8cec-92cd819d132f", "name": "network-vif-plugged", "status": "completed", "tag": "3d912156-66c3-4060-a4b0-45f5c1b2da29"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:19.216949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=4 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:19.223068 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-36914168-cf8e-48d0-b75d-942ef62d857f req-bccb1732-b2b5-4303-80b6-cb8204ef759b service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:19.223629 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-36914168-cf8e-48d0-b75d-942ef62d857f req-bccb1732-b2b5-4303-80b6-cb8204ef759b service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:19.236744 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-36914168-cf8e-48d0-b75d-942ef62d857f req-bccb1732-b2b5-4303-80b6-cb8204ef759b service nova] Creating event network-vif-plugged:3d912156-66c3-4060-a4b0-45f5c1b2da29 for instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f on hv-cinder-85070 Jul 21 23:41:19.244310 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-36914168-cf8e-48d0-b75d-942ef62d857f req-bccb1732-b2b5-4303-80b6-cb8204ef759b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037763 Jul 21 23:41:19.245936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 194/359] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:19.520315 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1360a067-152c-4031-ad03-c36f2c47ce3c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:19.520912 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1360a067-152c-4031-ad03-c36f2c47ce3c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:19.527662 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1360a067-152c-4031-ad03-c36f2c47ce3c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:19.528110 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1360a067-152c-4031-ad03-c36f2c47ce3c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:19.528882 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1360a067-152c-4031-ad03-c36f2c47ce3c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:19.529359 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1360a067-152c-4031-ad03-c36f2c47ce3c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:19.670262 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1360a067-152c-4031-ad03-c36f2c47ce3c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:19.678685 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1360a067-152c-4031-ad03-c36f2c47ce3c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:19.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1360a067-152c-4031-ad03-c36f2c47ce3c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:19.682163 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1360a067-152c-4031-ad03-c36f2c47ce3c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1663 microversion: 2.20 time: 0.165758 Jul 21 23:41:19.682721 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 166/360] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:19 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:19.701970 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c62582eb-792e-49ca-be8d-72cb2158028f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f06a04eb-6c34-425d-a409-d5b0b0ba71d9"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:19.703135 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c62582eb-792e-49ca-be8d-72cb2158028f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:19.709471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c62582eb-792e-49ca-be8d-72cb2158028f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:19.709919 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c62582eb-792e-49ca-be8d-72cb2158028f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:19.710855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c62582eb-792e-49ca-be8d-72cb2158028f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:19.711295 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c62582eb-792e-49ca-be8d-72cb2158028f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:19.795510 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c6d3ca03-fa08-46c4-ae1a-d36ed2af545e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:19.796247 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-c6d3ca03-fa08-46c4-ae1a-d36ed2af545e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:19.802591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c6d3ca03-fa08-46c4-ae1a-d36ed2af545e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:19.803148 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c6d3ca03-fa08-46c4-ae1a-d36ed2af545e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:19.803908 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c6d3ca03-fa08-46c4-ae1a-d36ed2af545e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:19.804966 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c6d3ca03-fa08-46c4-ae1a-d36ed2af545e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:19.954393 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c6d3ca03-fa08-46c4-ae1a-d36ed2af545e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:19.961871 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-c6d3ca03-fa08-46c4-ae1a-d36ed2af545e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.170815 Jul 21 23:41:19.962436 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 167/361] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:19 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:20.005244 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c62582eb-792e-49ca-be8d-72cb2158028f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "POST /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308116 Jul 21 23:41:20.006202 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 195/362] 10.222.0.57 () {62 vars in 1363 bytes} [Thu Jul 21 23:41:19 2022] POST /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 23:41:20.116339 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e22d9589-d70f-455c-8c3c-a05eeb13d30a tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:20.117595 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e22d9589-d70f-455c-8c3c-a05eeb13d30a tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:20.125487 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e22d9589-d70f-455c-8c3c-a05eeb13d30a tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:20.125943 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e22d9589-d70f-455c-8c3c-a05eeb13d30a tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:20.126722 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e22d9589-d70f-455c-8c3c-a05eeb13d30a tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:20.127168 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e22d9589-d70f-455c-8c3c-a05eeb13d30a tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:20.128959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3b21befe-6196-4ef0-91d7-826bb61a8ea8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:20.129827 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3b21befe-6196-4ef0-91d7-826bb61a8ea8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:20.136259 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b21befe-6196-4ef0-91d7-826bb61a8ea8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:20.136707 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b21befe-6196-4ef0-91d7-826bb61a8ea8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:20.137496 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b21befe-6196-4ef0-91d7-826bb61a8ea8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:20.137930 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3b21befe-6196-4ef0-91d7-826bb61a8ea8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:20.151759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e22d9589-d70f-455c-8c3c-a05eeb13d30a tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/ips" status: 200 len: 146 microversion: 2.1 time: 0.039114 Jul 21 23:41:20.152359 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 168/363] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 23:41:20 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:41:20.237816 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3b21befe-6196-4ef0-91d7-826bb61a8ea8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "POST /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/action" status: 202 len: 0 microversion: 2.20 time: 0.112224 Jul 21 23:41:20.238437 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 196/364] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jul 21 23:41:20 2022] POST /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:41:20.249378 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-395c8b1f-4c2c-43b3-a2e0-cee4c6b935c8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:20.252119 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-395c8b1f-4c2c-43b3-a2e0-cee4c6b935c8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:20.256539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-395c8b1f-4c2c-43b3-a2e0-cee4c6b935c8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:20.257032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-395c8b1f-4c2c-43b3-a2e0-cee4c6b935c8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:20.258446 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-395c8b1f-4c2c-43b3-a2e0-cee4c6b935c8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:20.258887 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-395c8b1f-4c2c-43b3-a2e0-cee4c6b935c8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:20.412830 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-395c8b1f-4c2c-43b3-a2e0-cee4c6b935c8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:20.422198 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-395c8b1f-4c2c-43b3-a2e0-cee4c6b935c8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:20.423712 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-395c8b1f-4c2c-43b3-a2e0-cee4c6b935c8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:20.424860 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-395c8b1f-4c2c-43b3-a2e0-cee4c6b935c8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.181483 Jul 21 23:41:20.425431 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 169/365] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:20 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:20.979297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0eabf65d-0daa-4f46-97ad-bba708c677e0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:20.979830 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0eabf65d-0daa-4f46-97ad-bba708c677e0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:20.987092 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0eabf65d-0daa-4f46-97ad-bba708c677e0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:20.987540 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0eabf65d-0daa-4f46-97ad-bba708c677e0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:20.988298 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0eabf65d-0daa-4f46-97ad-bba708c677e0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:20.988732 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0eabf65d-0daa-4f46-97ad-bba708c677e0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:21.123146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0eabf65d-0daa-4f46-97ad-bba708c677e0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:21.130836 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0eabf65d-0daa-4f46-97ad-bba708c677e0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1359 microversion: 2.1 time: 0.156097 Jul 21 23:41:21.131414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 197/366] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:20 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:21.283208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-01834591-6f55-4935-82e4-88a6348a5fe3 req-a15ca4c6-b530-4a20-b8a7-f5b0974668a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1e0d18-427a-456e-8ca0-c246e41f1fab", "name": "network-vif-unplugged", "status": "completed", "tag": "7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:21.292490 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-01834591-6f55-4935-82e4-88a6348a5fe3 req-a15ca4c6-b530-4a20-b8a7-f5b0974668a7 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:21.292931 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-01834591-6f55-4935-82e4-88a6348a5fe3 req-a15ca4c6-b530-4a20-b8a7-f5b0974668a7 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:21.306954 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.compute.server_external_events [req-01834591-6f55-4935-82e4-88a6348a5fe3 req-a15ca4c6-b530-4a20-b8a7-f5b0974668a7 service nova] Unable to find a host for instance eb1e0d18-427a-456e-8ca0-c246e41f1fab. Dropping event network-vif-unplugged {{(pid=124387) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 23:41:21.307844 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-01834591-6f55-4935-82e4-88a6348a5fe3 req-a15ca4c6-b530-4a20-b8a7-f5b0974668a7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028474 Jul 21 23:41:21.308416 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 170/367] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 21 23:41:21.444229 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b92d3298-2a4b-4e17-bbd9-ba8fbe0aa4ab tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:21.445310 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b92d3298-2a4b-4e17-bbd9-ba8fbe0aa4ab tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:21.452951 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b92d3298-2a4b-4e17-bbd9-ba8fbe0aa4ab tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:21.453473 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b92d3298-2a4b-4e17-bbd9-ba8fbe0aa4ab tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:21.454261 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b92d3298-2a4b-4e17-bbd9-ba8fbe0aa4ab tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:21.454725 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b92d3298-2a4b-4e17-bbd9-ba8fbe0aa4ab tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:21.600226 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b92d3298-2a4b-4e17-bbd9-ba8fbe0aa4ab tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:21.608704 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b92d3298-2a4b-4e17-bbd9-ba8fbe0aa4ab tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:21.610223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b92d3298-2a4b-4e17-bbd9-ba8fbe0aa4ab tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:21.611398 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b92d3298-2a4b-4e17-bbd9-ba8fbe0aa4ab tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.171167 Jul 21 23:41:21.611941 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 198/368] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:21 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:22.148364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bec3a212-95e1-4377-a706-a20635196801 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:22.149056 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bec3a212-95e1-4377-a706-a20635196801 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:22.155089 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bec3a212-95e1-4377-a706-a20635196801 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:22.155532 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bec3a212-95e1-4377-a706-a20635196801 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:22.156317 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bec3a212-95e1-4377-a706-a20635196801 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:22.156753 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bec3a212-95e1-4377-a706-a20635196801 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:22.297947 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bec3a212-95e1-4377-a706-a20635196801 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:22.306053 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bec3a212-95e1-4377-a706-a20635196801 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1549 microversion: 2.1 time: 0.162128 Jul 21 23:41:22.306607 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 171/369] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:22 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:22.323052 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ce7bef87-e4d9-41ca-9ae6-646725ae5f53 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:22.323637 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ce7bef87-e4d9-41ca-9ae6-646725ae5f53 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:22.330463 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce7bef87-e4d9-41ca-9ae6-646725ae5f53 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:22.330923 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce7bef87-e4d9-41ca-9ae6-646725ae5f53 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:22.331686 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce7bef87-e4d9-41ca-9ae6-646725ae5f53 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:22.332113 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce7bef87-e4d9-41ca-9ae6-646725ae5f53 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:22.467464 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ce7bef87-e4d9-41ca-9ae6-646725ae5f53 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:22.475041 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ce7bef87-e4d9-41ca-9ae6-646725ae5f53 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1549 microversion: 2.1 time: 0.156691 Jul 21 23:41:22.475639 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 199/370] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:22 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:22.491018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-67ab8818-fa0b-4fb4-91b6-eee432b959fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:22.494650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-67ab8818-fa0b-4fb4-91b6-eee432b959fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:22.495670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-67ab8818-fa0b-4fb4-91b6-eee432b959fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Searching by: {'deleted': False, 'project_id': '235634c0fcf14ebeab084cfca36d394b'} {{(pid=124387) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 23:41:22.502296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-67ab8818-fa0b-4fb4-91b6-eee432b959fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:22.502741 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-67ab8818-fa0b-4fb4-91b6-eee432b959fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:22.503557 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-67ab8818-fa0b-4fb4-91b6-eee432b959fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:22.503989 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-67ab8818-fa0b-4fb4-91b6-eee432b959fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:22.593405 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.multi_cell_list [None req-67ab8818-fa0b-4fb4-91b6-eee432b959fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124387) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 23:41:22.630974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ce15759f-479e-40c8-9355-82d7f5ad2a3b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:22.631509 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ce15759f-479e-40c8-9355-82d7f5ad2a3b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:22.638106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce15759f-479e-40c8-9355-82d7f5ad2a3b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:22.638560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce15759f-479e-40c8-9355-82d7f5ad2a3b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:22.639345 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce15759f-479e-40c8-9355-82d7f5ad2a3b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:22.639788 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce15759f-479e-40c8-9355-82d7f5ad2a3b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:22.686883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-67ab8818-fa0b-4fb4-91b6-eee432b959fa tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199490 Jul 21 23:41:22.687645 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 172/371] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jul 21 23:41:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:22.698367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-fe583d51-c62d-4892-b704-f4dac4a39bed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:22.698978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-fe583d51-c62d-4892-b704-f4dac4a39bed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:22.704923 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fe583d51-c62d-4892-b704-f4dac4a39bed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:22.705407 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fe583d51-c62d-4892-b704-f4dac4a39bed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:22.706175 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fe583d51-c62d-4892-b704-f4dac4a39bed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:22.706610 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fe583d51-c62d-4892-b704-f4dac4a39bed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:22.789890 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ce15759f-479e-40c8-9355-82d7f5ad2a3b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:22.798515 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ce15759f-479e-40c8-9355-82d7f5ad2a3b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:22.800053 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ce15759f-479e-40c8-9355-82d7f5ad2a3b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:22.801293 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ce15759f-479e-40c8-9355-82d7f5ad2a3b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.174184 Jul 21 23:41:22.801847 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 200/372] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:22 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:22.851480 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-fe583d51-c62d-4892-b704-f4dac4a39bed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:22.860423 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-fe583d51-c62d-4892-b704-f4dac4a39bed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1549 microversion: 2.1 time: 0.166605 Jul 21 23:41:22.861003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 173/373] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:22 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:23.821725 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-483c33d6-ba45-434a-8eee-0344b299881e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:23.822536 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-483c33d6-ba45-434a-8eee-0344b299881e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:23.830429 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-483c33d6-ba45-434a-8eee-0344b299881e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:23.830881 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-483c33d6-ba45-434a-8eee-0344b299881e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:23.831660 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-483c33d6-ba45-434a-8eee-0344b299881e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:23.832095 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-483c33d6-ba45-434a-8eee-0344b299881e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:23.980073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-483c33d6-ba45-434a-8eee-0344b299881e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:23.989281 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-483c33d6-ba45-434a-8eee-0344b299881e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:23.991135 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-483c33d6-ba45-434a-8eee-0344b299881e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:23.993099 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-483c33d6-ba45-434a-8eee-0344b299881e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.176716 Jul 21 23:41:23.993685 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 201/374] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:23 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:24.404990 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9a3c8ac5-78a3-41d3-9bca-506cca1eb9e7 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02e9525f-f62a-4596-8ca5-94218027e152"}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:24.406348 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9a3c8ac5-78a3-41d3-9bca-506cca1eb9e7 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:24.413912 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9a3c8ac5-78a3-41d3-9bca-506cca1eb9e7 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:24.414361 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9a3c8ac5-78a3-41d3-9bca-506cca1eb9e7 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:24.415139 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9a3c8ac5-78a3-41d3-9bca-506cca1eb9e7 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:24.415576 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9a3c8ac5-78a3-41d3-9bca-506cca1eb9e7 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:24.684960 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9a3c8ac5-78a3-41d3-9bca-506cca1eb9e7 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "POST /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283770 Jul 21 23:41:24.685610 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 174/375] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:41:24 2022] POST /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:25.012679 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-78d47a61-62e8-43c3-bb0d-7c48598a5f32 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:25.013358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-78d47a61-62e8-43c3-bb0d-7c48598a5f32 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:25.019759 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78d47a61-62e8-43c3-bb0d-7c48598a5f32 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:25.020204 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78d47a61-62e8-43c3-bb0d-7c48598a5f32 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:25.020961 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78d47a61-62e8-43c3-bb0d-7c48598a5f32 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:25.021491 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-78d47a61-62e8-43c3-bb0d-7c48598a5f32 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:25.146123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e3f2ba33-46a9-4c48-8153-715c686e039f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0027b7bd-b25d-44c2-b48e-f0122ffbcf5d"}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:25.147324 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e3f2ba33-46a9-4c48-8153-715c686e039f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:25.153650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e3f2ba33-46a9-4c48-8153-715c686e039f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:25.154076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e3f2ba33-46a9-4c48-8153-715c686e039f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:25.154877 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e3f2ba33-46a9-4c48-8153-715c686e039f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:25.155281 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e3f2ba33-46a9-4c48-8153-715c686e039f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:25.166956 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-78d47a61-62e8-43c3-bb0d-7c48598a5f32 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:25.175345 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-78d47a61-62e8-43c3-bb0d-7c48598a5f32 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:25.176931 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-78d47a61-62e8-43c3-bb0d-7c48598a5f32 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:25.178192 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-78d47a61-62e8-43c3-bb0d-7c48598a5f32 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.169381 Jul 21 23:41:25.178832 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 202/376] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:25 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:25.435368 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e3f2ba33-46a9-4c48-8153-715c686e039f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "POST /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293957 Jul 21 23:41:25.436471 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 175/377] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:41:25 2022] POST /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:26.197572 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9b8c920e-be57-4b22-a503-d1be35b81a96 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:26.198119 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9b8c920e-be57-4b22-a503-d1be35b81a96 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:26.204462 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b8c920e-be57-4b22-a503-d1be35b81a96 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:26.204904 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b8c920e-be57-4b22-a503-d1be35b81a96 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:26.205686 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b8c920e-be57-4b22-a503-d1be35b81a96 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:26.206116 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b8c920e-be57-4b22-a503-d1be35b81a96 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:26.342470 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9b8c920e-be57-4b22-a503-d1be35b81a96 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:26.351467 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9b8c920e-be57-4b22-a503-d1be35b81a96 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:26.354213 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9b8c920e-be57-4b22-a503-d1be35b81a96 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:26.355718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9b8c920e-be57-4b22-a503-d1be35b81a96 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.162206 Jul 21 23:41:26.356281 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 203/378] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:26 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:27.375876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-597e974e-8f34-4aed-bcf4-9d3fc2e98398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:27.376485 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-597e974e-8f34-4aed-bcf4-9d3fc2e98398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:27.383257 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-597e974e-8f34-4aed-bcf4-9d3fc2e98398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:27.384224 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-597e974e-8f34-4aed-bcf4-9d3fc2e98398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:27.385674 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-597e974e-8f34-4aed-bcf4-9d3fc2e98398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:27.386107 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-597e974e-8f34-4aed-bcf4-9d3fc2e98398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:27.519739 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-597e974e-8f34-4aed-bcf4-9d3fc2e98398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:27.528565 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-597e974e-8f34-4aed-bcf4-9d3fc2e98398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:27.530081 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-597e974e-8f34-4aed-bcf4-9d3fc2e98398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:27.531212 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-597e974e-8f34-4aed-bcf4-9d3fc2e98398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.159831 Jul 21 23:41:27.531759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 176/379] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:27 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:28.549373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bee0faca-efc6-42d6-ae16-242b07e0ed1f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:28.550003 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bee0faca-efc6-42d6-ae16-242b07e0ed1f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:28.557240 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bee0faca-efc6-42d6-ae16-242b07e0ed1f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:28.557684 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bee0faca-efc6-42d6-ae16-242b07e0ed1f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:28.558436 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bee0faca-efc6-42d6-ae16-242b07e0ed1f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:28.558872 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bee0faca-efc6-42d6-ae16-242b07e0ed1f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:28.695315 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bee0faca-efc6-42d6-ae16-242b07e0ed1f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:28.704986 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bee0faca-efc6-42d6-ae16-242b07e0ed1f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:28.706508 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bee0faca-efc6-42d6-ae16-242b07e0ed1f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:28.707650 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bee0faca-efc6-42d6-ae16-242b07e0ed1f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.162241 Jul 21 23:41:28.708200 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 204/380] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:28 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:29.726097 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a1e0d3e0-c8ef-4341-af63-f62c60a9e3be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:29.726700 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-a1e0d3e0-c8ef-4341-af63-f62c60a9e3be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:29.733674 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a1e0d3e0-c8ef-4341-af63-f62c60a9e3be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:29.734111 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a1e0d3e0-c8ef-4341-af63-f62c60a9e3be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:29.734873 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a1e0d3e0-c8ef-4341-af63-f62c60a9e3be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:29.735299 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a1e0d3e0-c8ef-4341-af63-f62c60a9e3be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:29.872294 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a1e0d3e0-c8ef-4341-af63-f62c60a9e3be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:29.882198 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a1e0d3e0-c8ef-4341-af63-f62c60a9e3be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:29.884369 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a1e0d3e0-c8ef-4341-af63-f62c60a9e3be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:29.885794 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a1e0d3e0-c8ef-4341-af63-f62c60a9e3be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.163645 Jul 21 23:41:29.886410 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 177/381] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:29 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:30.905644 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8f777be6-33e7-4ef9-a4f7-25bec85c8bc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:30.906407 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8f777be6-33e7-4ef9-a4f7-25bec85c8bc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:30.913262 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f777be6-33e7-4ef9-a4f7-25bec85c8bc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:30.914133 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f777be6-33e7-4ef9-a4f7-25bec85c8bc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:30.914489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f777be6-33e7-4ef9-a4f7-25bec85c8bc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:30.915051 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f777be6-33e7-4ef9-a4f7-25bec85c8bc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:31.062974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8f777be6-33e7-4ef9-a4f7-25bec85c8bc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:31.071615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8f777be6-33e7-4ef9-a4f7-25bec85c8bc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:31.073133 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8f777be6-33e7-4ef9-a4f7-25bec85c8bc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:31.074319 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8f777be6-33e7-4ef9-a4f7-25bec85c8bc4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.172572 Jul 21 23:41:31.074874 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 205/382] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:30 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:32.092042 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-311efd1b-cd8c-4af6-90b2-7e4118bf7060 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:32.092641 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-311efd1b-cd8c-4af6-90b2-7e4118bf7060 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:32.099431 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-311efd1b-cd8c-4af6-90b2-7e4118bf7060 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:32.099880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-311efd1b-cd8c-4af6-90b2-7e4118bf7060 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:32.100648 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-311efd1b-cd8c-4af6-90b2-7e4118bf7060 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:32.101056 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-311efd1b-cd8c-4af6-90b2-7e4118bf7060 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:32.241845 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-311efd1b-cd8c-4af6-90b2-7e4118bf7060 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:32.252586 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-311efd1b-cd8c-4af6-90b2-7e4118bf7060 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:32.255086 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-311efd1b-cd8c-4af6-90b2-7e4118bf7060 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:32.259200 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-311efd1b-cd8c-4af6-90b2-7e4118bf7060 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.168749 Jul 21 23:41:32.259200 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 178/383] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:32 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:33.280130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f84f937f-857a-4aaa-b8a6-358a37b007db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:33.280735 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f84f937f-857a-4aaa-b8a6-358a37b007db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:33.287441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f84f937f-857a-4aaa-b8a6-358a37b007db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:33.287889 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f84f937f-857a-4aaa-b8a6-358a37b007db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:33.288659 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f84f937f-857a-4aaa-b8a6-358a37b007db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:33.289098 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f84f937f-857a-4aaa-b8a6-358a37b007db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:33.293129 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:33.435795 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f84f937f-857a-4aaa-b8a6-358a37b007db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:33.444509 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f84f937f-857a-4aaa-b8a6-358a37b007db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:33.446054 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f84f937f-857a-4aaa-b8a6-358a37b007db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:33.447217 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f84f937f-857a-4aaa-b8a6-358a37b007db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.171827 Jul 21 23:41:33.454344 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 206/384] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:33 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:34.466180 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-cf015bcb-0cdb-440c-aeec-794fea796c5a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:34.466781 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-cf015bcb-0cdb-440c-aeec-794fea796c5a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:34.468725 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:34.469963 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=52 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:34.478067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cf015bcb-0cdb-440c-aeec-794fea796c5a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:34.478500 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cf015bcb-0cdb-440c-aeec-794fea796c5a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:34.481397 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cf015bcb-0cdb-440c-aeec-794fea796c5a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:34.481840 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cf015bcb-0cdb-440c-aeec-794fea796c5a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:34.633453 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cf015bcb-0cdb-440c-aeec-794fea796c5a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:34.644332 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cf015bcb-0cdb-440c-aeec-794fea796c5a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:34.645929 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cf015bcb-0cdb-440c-aeec-794fea796c5a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:34.647078 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-cf015bcb-0cdb-440c-aeec-794fea796c5a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.185508 Jul 21 23:41:34.647629 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 179/385] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:34 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:35.677631 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2859c045-4927-4504-a579-d96d50e460af tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:35.678203 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2859c045-4927-4504-a579-d96d50e460af tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:35.684591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2859c045-4927-4504-a579-d96d50e460af tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:35.685039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2859c045-4927-4504-a579-d96d50e460af tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:35.685840 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2859c045-4927-4504-a579-d96d50e460af tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:35.686275 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2859c045-4927-4504-a579-d96d50e460af tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:35.818146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2859c045-4927-4504-a579-d96d50e460af tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:35.826354 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2859c045-4927-4504-a579-d96d50e460af tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:35.827819 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2859c045-4927-4504-a579-d96d50e460af tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:35.828952 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2859c045-4927-4504-a579-d96d50e460af tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1749 microversion: 2.20 time: 0.155408 Jul 21 23:41:35.829535 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 207/386] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:35 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:36.619730 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-284579983", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1308624493", "security_groups": [{"name": "tempest-secgroup-smoke-311382891"}], "block_device_mapping_v2": [{"uuid": "008decd9-f34d-48fb-b4d8-8d5a6b00ecda", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "090d43b6-0e83-430b-8cf2-7b66d14a91c7"}]}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:36.782849 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] validate_networks() for [('090d43b6-0e83-430b-8cf2-7b66d14a91c7', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:41:36.847949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a6d80e61-a2a1-4235-8b6f-715ade5f4e6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:36.848716 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a6d80e61-a2a1-4235-8b6f-715ade5f4e6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:36.851173 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:36.856779 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a6d80e61-a2a1-4235-8b6f-715ade5f4e6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:36.857343 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a6d80e61-a2a1-4235-8b6f-715ade5f4e6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:36.858125 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a6d80e61-a2a1-4235-8b6f-715ade5f4e6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:36.858683 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a6d80e61-a2a1-4235-8b6f-715ade5f4e6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:36.991738 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a6d80e61-a2a1-4235-8b6f-715ade5f4e6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:37.001022 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a6d80e61-a2a1-4235-8b6f-715ade5f4e6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:37.002560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a6d80e61-a2a1-4235-8b6f-715ade5f4e6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:37.003726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a6d80e61-a2a1-4235-8b6f-715ade5f4e6f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1751 microversion: 2.20 time: 0.159838 Jul 21 23:41:37.004280 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 208/387] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:36 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:37.317854 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:41:37.318276 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:41:37.318748 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:41:37.319158 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:41:37.319570 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:41:37.329108 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:37.329589 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:37.330388 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:37.330826 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:37.337412 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:37.349664 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Getting quotas for project 44fb74dd337c49a898397e3482e4305d. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:41:37.354611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Getting quotas for user 26738ea4f6d54d7d81f1ec5057c237ff and project 44fb74dd337c49a898397e3482e4305d. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:41:37.412131 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:41:37.414284 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='008decd9-f34d-48fb-b4d8-8d5a6b00ecda',volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:41:37.522287 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bd6c67df-0100-44c9-bbd6-3ba573ff4d69 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:37.523159 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bd6c67df-0100-44c9-bbd6-3ba573ff4d69 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:37.529949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd6c67df-0100-44c9-bbd6-3ba573ff4d69 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:37.530619 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd6c67df-0100-44c9-bbd6-3ba573ff4d69 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:37.531590 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd6c67df-0100-44c9-bbd6-3ba573ff4d69 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:37.532454 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd6c67df-0100-44c9-bbd6-3ba573ff4d69 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:37.545343 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bce74905-28e1-4ec0-a1d4-73bdf907910b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.929751 Jul 21 23:41:37.545992 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 180/388] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:41:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:41:37.556278 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-21e79040-c913-477d-9ad4-d42aa5752d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:37.556936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-21e79040-c913-477d-9ad4-d42aa5752d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:37.619752 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-21e79040-c913-477d-9ad4-d42aa5752d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:37.628202 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-21e79040-c913-477d-9ad4-d42aa5752d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1094 microversion: 2.1 time: 0.075982 Jul 21 23:41:37.629333 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 181/389] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:37 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:37.702994 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bd6c67df-0100-44c9-bbd6-3ba573ff4d69 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:37.712107 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bd6c67df-0100-44c9-bbd6-3ba573ff4d69 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1595 microversion: 2.1 time: 0.195166 Jul 21 23:41:37.713815 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 209/390] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:37 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1595 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:38.023067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-25cd0e57-23bf-4e47-bf2c-e33e593298b7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:38.023676 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-25cd0e57-23bf-4e47-bf2c-e33e593298b7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:38.030872 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-25cd0e57-23bf-4e47-bf2c-e33e593298b7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:38.031325 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-25cd0e57-23bf-4e47-bf2c-e33e593298b7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:38.032099 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-25cd0e57-23bf-4e47-bf2c-e33e593298b7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:38.032535 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-25cd0e57-23bf-4e47-bf2c-e33e593298b7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:38.252213 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-25cd0e57-23bf-4e47-bf2c-e33e593298b7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:38.261144 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-25cd0e57-23bf-4e47-bf2c-e33e593298b7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:38.262684 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-25cd0e57-23bf-4e47-bf2c-e33e593298b7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:38.264099 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-25cd0e57-23bf-4e47-bf2c-e33e593298b7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1751 microversion: 2.20 time: 0.244814 Jul 21 23:41:38.264498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 182/391] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:38 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1751 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:38.645913 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3f871467-a963-41c0-ad46-0fa3982f493f tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:38.646476 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3f871467-a963-41c0-ad46-0fa3982f493f tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:38.654519 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3f871467-a963-41c0-ad46-0fa3982f493f tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:38.654983 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3f871467-a963-41c0-ad46-0fa3982f493f tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:38.655816 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3f871467-a963-41c0-ad46-0fa3982f493f tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:38.656249 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3f871467-a963-41c0-ad46-0fa3982f493f tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:38.720300 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3f871467-a963-41c0-ad46-0fa3982f493f tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:38.727636 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3f871467-a963-41c0-ad46-0fa3982f493f tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1192 microversion: 2.1 time: 0.085711 Jul 21 23:41:38.728199 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 210/392] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:38 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:39.283380 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bfeef2f7-e90b-4e40-93f9-f8291745a981 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:39.283935 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bfeef2f7-e90b-4e40-93f9-f8291745a981 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:39.290162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bfeef2f7-e90b-4e40-93f9-f8291745a981 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:39.290609 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bfeef2f7-e90b-4e40-93f9-f8291745a981 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:39.291409 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bfeef2f7-e90b-4e40-93f9-f8291745a981 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:39.292070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bfeef2f7-e90b-4e40-93f9-f8291745a981 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:39.746339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-08a1a33d-d306-4a28-b131-9928c45dbdcf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:39.747173 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-08a1a33d-d306-4a28-b131-9928c45dbdcf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:39.754332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-08a1a33d-d306-4a28-b131-9928c45dbdcf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:39.755005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-08a1a33d-d306-4a28-b131-9928c45dbdcf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:39.755789 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-08a1a33d-d306-4a28-b131-9928c45dbdcf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:39.756233 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-08a1a33d-d306-4a28-b131-9928c45dbdcf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:39.829406 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-08a1a33d-d306-4a28-b131-9928c45dbdcf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:39.840825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-08a1a33d-d306-4a28-b131-9928c45dbdcf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1210 microversion: 2.1 time: 0.098953 Jul 21 23:41:39.841588 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 211/393] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:39 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:39.876931 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bfeef2f7-e90b-4e40-93f9-f8291745a981 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:39.890939 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bfeef2f7-e90b-4e40-93f9-f8291745a981 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:39.892654 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bfeef2f7-e90b-4e40-93f9-f8291745a981 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:39.894016 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bfeef2f7-e90b-4e40-93f9-f8291745a981 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1751 microversion: 2.20 time: 0.614623 Jul 21 23:41:39.894815 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 183/394] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:39 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1751 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:40.116105 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c6df0023-3288-4df4-836f-d27eac909c33 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc7f06e4-37b6-4899-9ab2-5eb594f4b0c9"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:40.117373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c6df0023-3288-4df4-836f-d27eac909c33 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:40.123922 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c6df0023-3288-4df4-836f-d27eac909c33 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:40.124362 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c6df0023-3288-4df4-836f-d27eac909c33 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:40.125119 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c6df0023-3288-4df4-836f-d27eac909c33 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:40.125640 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c6df0023-3288-4df4-836f-d27eac909c33 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:40.368183 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-e84994e4-e28e-4db5-91f0-b19750043918 req-ad1b2141-1318-45f0-87c6-55c66088e353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5fa3e4-c19a-40ef-8cec-92cd819d132f", "tag": "3d912156-66c3-4060-a4b0-45f5c1b2da29"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:40.382753 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-e84994e4-e28e-4db5-91f0-b19750043918 req-ad1b2141-1318-45f0-87c6-55c66088e353 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:40.386241 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-e84994e4-e28e-4db5-91f0-b19750043918 req-ad1b2141-1318-45f0-87c6-55c66088e353 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:40.401314 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-e84994e4-e28e-4db5-91f0-b19750043918 req-ad1b2141-1318-45f0-87c6-55c66088e353 service nova] Creating event network-changed:3d912156-66c3-4060-a4b0-45f5c1b2da29 for instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f on hv-cinder-85070 Jul 21 23:41:40.407919 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-e84994e4-e28e-4db5-91f0-b19750043918 req-ad1b2141-1318-45f0-87c6-55c66088e353 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043716 Jul 21 23:41:40.409155 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 184/395] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:40.462387 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c6df0023-3288-4df4-836f-d27eac909c33 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "POST /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349941 Jul 21 23:41:40.469849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 212/396] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:41:40 2022] POST /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:40.860892 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-cada3f45-572f-4633-b024-04a94adcf6ef tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:40.863829 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-cada3f45-572f-4633-b024-04a94adcf6ef tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:40.874055 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cada3f45-572f-4633-b024-04a94adcf6ef tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:40.875023 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cada3f45-572f-4633-b024-04a94adcf6ef tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:40.876687 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cada3f45-572f-4633-b024-04a94adcf6ef tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:40.878251 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cada3f45-572f-4633-b024-04a94adcf6ef tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:40.914007 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-95a390c9-f274-4d1f-b401-9cc3d2b393ca tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:40.916017 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-95a390c9-f274-4d1f-b401-9cc3d2b393ca tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:40.934009 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95a390c9-f274-4d1f-b401-9cc3d2b393ca tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:40.934467 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95a390c9-f274-4d1f-b401-9cc3d2b393ca tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:40.946080 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95a390c9-f274-4d1f-b401-9cc3d2b393ca tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:40.946543 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95a390c9-f274-4d1f-b401-9cc3d2b393ca tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:41.283232 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-95a390c9-f274-4d1f-b401-9cc3d2b393ca tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:41.302387 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-95a390c9-f274-4d1f-b401-9cc3d2b393ca tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:41.305594 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-95a390c9-f274-4d1f-b401-9cc3d2b393ca tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:41.308172 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-95a390c9-f274-4d1f-b401-9cc3d2b393ca tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1751 microversion: 2.20 time: 0.397629 Jul 21 23:41:41.310141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 213/397] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:40 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1751 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:41.390523 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cada3f45-572f-4633-b024-04a94adcf6ef tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:41.403725 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-cada3f45-572f-4633-b024-04a94adcf6ef tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1277 microversion: 2.1 time: 0.547272 Jul 21 23:41:41.404930 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 185/398] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:40 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1277 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:42.015032 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-33a153de-7771-4adb-a59f-f78715d3fea1 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1726777768"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:42.015663 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-33a153de-7771-4adb-a59f-f78715d3fea1 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:42.022657 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33a153de-7771-4adb-a59f-f78715d3fea1 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:42.023106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33a153de-7771-4adb-a59f-f78715d3fea1 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:42.023875 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33a153de-7771-4adb-a59f-f78715d3fea1 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:42.024307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33a153de-7771-4adb-a59f-f78715d3fea1 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:42.177679 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.network.security_group_api [None req-33a153de-7771-4adb-a59f-f78715d3fea1 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Adding security group 5d1c61dd-f060-46d3-a82f-350a6ea95119 to port 3d912156-66c3-4060-a4b0-45f5c1b2da29 Jul 21 23:41:42.328652 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c3208a53-a917-463c-8323-25ce2f6cdfa0 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:42.329561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-c3208a53-a917-463c-8323-25ce2f6cdfa0 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:42.340029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c3208a53-a917-463c-8323-25ce2f6cdfa0 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:42.340474 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c3208a53-a917-463c-8323-25ce2f6cdfa0 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:42.341631 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c3208a53-a917-463c-8323-25ce2f6cdfa0 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:42.342270 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c3208a53-a917-463c-8323-25ce2f6cdfa0 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:42.559373 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c3208a53-a917-463c-8323-25ce2f6cdfa0 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:42.568734 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c3208a53-a917-463c-8323-25ce2f6cdfa0 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:42.570260 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c3208a53-a917-463c-8323-25ce2f6cdfa0 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:42.571426 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-c3208a53-a917-463c-8323-25ce2f6cdfa0 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1751 microversion: 2.20 time: 0.246801 Jul 21 23:41:42.572052 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 186/399] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:42 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1751 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:42.576613 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4f8d2fb4-74d0-4181-a256-45d8c1aecd0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:42.577231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4f8d2fb4-74d0-4181-a256-45d8c1aecd0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:42.583813 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4f8d2fb4-74d0-4181-a256-45d8c1aecd0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:42.584270 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4f8d2fb4-74d0-4181-a256-45d8c1aecd0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:42.585101 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4f8d2fb4-74d0-4181-a256-45d8c1aecd0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:42.585564 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4f8d2fb4-74d0-4181-a256-45d8c1aecd0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:42.635906 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-33a153de-7771-4adb-a59f-f78715d3fea1 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "POST /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/action" status: 202 len: 0 microversion: 2.1 time: 0.624307 Jul 21 23:41:42.640835 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 214/400] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:41:42 2022] POST /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:41:42.656876 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-4d8b55db-26ec-4880-9798-6eec1e275f58 req-7b7ac793-906b-47ad-8558-5d8642aeb7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1b0372-60fe-4345-9668-12276af08fda", "tag": "3fba9807-20fe-41d5-8c1a-0473403d7805"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:42.695048 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4d8b55db-26ec-4880-9798-6eec1e275f58 req-7b7ac793-906b-47ad-8558-5d8642aeb7b2 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:42.695745 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4d8b55db-26ec-4880-9798-6eec1e275f58 req-7b7ac793-906b-47ad-8558-5d8642aeb7b2 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:42.718117 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-4d8b55db-26ec-4880-9798-6eec1e275f58 req-7b7ac793-906b-47ad-8558-5d8642aeb7b2 service nova] Creating event network-changed:3fba9807-20fe-41d5-8c1a-0473403d7805 for instance fc1b0372-60fe-4345-9668-12276af08fda on hv-cinder-85070 Jul 21 23:41:42.730627 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-4d8b55db-26ec-4880-9798-6eec1e275f58 req-7b7ac793-906b-47ad-8558-5d8642aeb7b2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085431 Jul 21 23:41:42.731346 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 215/401] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:42.738909 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-3495eafb-5425-4798-a071-b81bd4c8ed7a req-9274af1d-181d-4784-9901-4eede91e0e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5fa3e4-c19a-40ef-8cec-92cd819d132f", "tag": "3d912156-66c3-4060-a4b0-45f5c1b2da29"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:42.753455 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-3495eafb-5425-4798-a071-b81bd4c8ed7a req-9274af1d-181d-4784-9901-4eede91e0e17 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:42.754115 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-3495eafb-5425-4798-a071-b81bd4c8ed7a req-9274af1d-181d-4784-9901-4eede91e0e17 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:42.779641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-3495eafb-5425-4798-a071-b81bd4c8ed7a req-9274af1d-181d-4784-9901-4eede91e0e17 service nova] Creating event network-changed:3d912156-66c3-4060-a4b0-45f5c1b2da29 for instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f on hv-cinder-85070 Jul 21 23:41:42.785927 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-3495eafb-5425-4798-a071-b81bd4c8ed7a req-9274af1d-181d-4784-9901-4eede91e0e17 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052810 Jul 21 23:41:42.790178 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 216/402] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:41:42.797010 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4fdd998d-48f2-4e84-815c-d38f01a79747 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:42.797902 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4fdd998d-48f2-4e84-815c-d38f01a79747 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:42.804368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4fdd998d-48f2-4e84-815c-d38f01a79747 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:42.805026 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4fdd998d-48f2-4e84-815c-d38f01a79747 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:42.806007 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4fdd998d-48f2-4e84-815c-d38f01a79747 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:42.807767 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4fdd998d-48f2-4e84-815c-d38f01a79747 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:42.823806 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4f8d2fb4-74d0-4181-a256-45d8c1aecd0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:42.834107 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4f8d2fb4-74d0-4181-a256-45d8c1aecd0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1277 microversion: 2.1 time: 0.260953 Jul 21 23:41:42.844410 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 187/403] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:42 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:43.003082 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4fdd998d-48f2-4e84-815c-d38f01a79747 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:43.013643 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4fdd998d-48f2-4e84-815c-d38f01a79747 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1761 microversion: 2.1 time: 0.221361 Jul 21 23:41:43.014560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 217/404] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:42 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1761 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:43.594631 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-be659e44-b69d-452e-9a51-ae77764a829d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:43.595419 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-be659e44-b69d-452e-9a51-ae77764a829d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:43.609889 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-be659e44-b69d-452e-9a51-ae77764a829d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:43.610347 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-be659e44-b69d-452e-9a51-ae77764a829d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:43.613835 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-be659e44-b69d-452e-9a51-ae77764a829d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:43.614608 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-be659e44-b69d-452e-9a51-ae77764a829d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:43.635893 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ed90cb6e-abd0-41c9-ab27-0bcc1856ccd3 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:41:43.654108 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed90cb6e-abd0-41c9-ab27-0bcc1856ccd3 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:43.654717 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed90cb6e-abd0-41c9-ab27-0bcc1856ccd3 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:43.741479 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ed90cb6e-abd0-41c9-ab27-0bcc1856ccd3 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Going to try to stop instance {{(pid=124388) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 23:41:43.818553 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ed90cb6e-abd0-41c9-ab27-0bcc1856ccd3 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "POST /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/action" status: 202 len: 0 microversion: 2.1 time: 0.189301 Jul 21 23:41:43.820756 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 218/405] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:41:43 2022] POST /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:41:43.831073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e3e11dfa-1531-496e-b168-653edd14334c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:43.832067 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e3e11dfa-1531-496e-b168-653edd14334c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:43.839813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3e11dfa-1531-496e-b168-653edd14334c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:43.840232 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3e11dfa-1531-496e-b168-653edd14334c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:43.841157 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3e11dfa-1531-496e-b168-653edd14334c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:43.841762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3e11dfa-1531-496e-b168-653edd14334c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:44.008658 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e3e11dfa-1531-496e-b168-653edd14334c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:44.017564 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e3e11dfa-1531-496e-b168-653edd14334c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.191113 Jul 21 23:41:44.018240 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 219/406] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:43 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:44.029320 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-385d72c8-6d20-4bb6-ab34-4e9b9d84eabf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:44.030555 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-385d72c8-6d20-4bb6-ab34-4e9b9d84eabf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:44.036064 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-385d72c8-6d20-4bb6-ab34-4e9b9d84eabf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:44.036512 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-385d72c8-6d20-4bb6-ab34-4e9b9d84eabf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:44.037471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-385d72c8-6d20-4bb6-ab34-4e9b9d84eabf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:44.037908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-385d72c8-6d20-4bb6-ab34-4e9b9d84eabf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:44.170612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-be659e44-b69d-452e-9a51-ae77764a829d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:44.179499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-be659e44-b69d-452e-9a51-ae77764a829d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:44.181045 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-be659e44-b69d-452e-9a51-ae77764a829d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:44.182911 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-be659e44-b69d-452e-9a51-ae77764a829d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1751 microversion: 2.20 time: 0.595116 Jul 21 23:41:44.183481 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 188/407] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:43 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1751 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:44.185990 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-385d72c8-6d20-4bb6-ab34-4e9b9d84eabf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:44.193273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-385d72c8-6d20-4bb6-ab34-4e9b9d84eabf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1277 microversion: 2.1 time: 0.169431 Jul 21 23:41:44.193821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 220/408] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:44 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:45.035931 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-05f431a1-05bb-456f-adca-8c44c2a0b004 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:45.036646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-05f431a1-05bb-456f-adca-8c44c2a0b004 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:45.046338 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-05f431a1-05bb-456f-adca-8c44c2a0b004 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:45.046871 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-05f431a1-05bb-456f-adca-8c44c2a0b004 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:45.047726 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-05f431a1-05bb-456f-adca-8c44c2a0b004 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:45.048240 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-05f431a1-05bb-456f-adca-8c44c2a0b004 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:45.201910 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ed7504e2-30bb-4897-8974-0e13ef075684 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:45.202540 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ed7504e2-30bb-4897-8974-0e13ef075684 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:45.209952 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed7504e2-30bb-4897-8974-0e13ef075684 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:45.210492 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed7504e2-30bb-4897-8974-0e13ef075684 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:45.211331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed7504e2-30bb-4897-8974-0e13ef075684 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:45.211831 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ed7504e2-30bb-4897-8974-0e13ef075684 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:45.308922 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-05f431a1-05bb-456f-adca-8c44c2a0b004 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:45.317708 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-05f431a1-05bb-456f-adca-8c44c2a0b004 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.285731 Jul 21 23:41:45.318593 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 189/409] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:45 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:45.324046 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0a5a0538-026f-4c2e-ab68-d212b11056cb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:45.325130 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0a5a0538-026f-4c2e-ab68-d212b11056cb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:45.332028 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a5a0538-026f-4c2e-ab68-d212b11056cb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:45.332481 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a5a0538-026f-4c2e-ab68-d212b11056cb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:45.333480 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a5a0538-026f-4c2e-ab68-d212b11056cb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:45.334073 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a5a0538-026f-4c2e-ab68-d212b11056cb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:45.443430 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ed7504e2-30bb-4897-8974-0e13ef075684 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:45.452300 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ed7504e2-30bb-4897-8974-0e13ef075684 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:45.453840 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ed7504e2-30bb-4897-8974-0e13ef075684 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:45.455013 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ed7504e2-30bb-4897-8974-0e13ef075684 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.257674 Jul 21 23:41:45.458681 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 221/410] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:45 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:45.569264 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0a5a0538-026f-4c2e-ab68-d212b11056cb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:45.578460 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0a5a0538-026f-4c2e-ab68-d212b11056cb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.258118 Jul 21 23:41:45.579399 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 190/411] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:45 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:46.335131 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9de6e350-f345-4560-ae6d-c087894e4259 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:46.336433 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9de6e350-f345-4560-ae6d-c087894e4259 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:46.351020 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9de6e350-f345-4560-ae6d-c087894e4259 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:46.351854 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9de6e350-f345-4560-ae6d-c087894e4259 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:46.352873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9de6e350-f345-4560-ae6d-c087894e4259 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:46.353554 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9de6e350-f345-4560-ae6d-c087894e4259 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:46.380715 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:46.474175 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1642e43f-4698-4cf5-b182-b825911c586d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:46.474785 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1642e43f-4698-4cf5-b182-b825911c586d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:46.487861 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1642e43f-4698-4cf5-b182-b825911c586d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:46.488589 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1642e43f-4698-4cf5-b182-b825911c586d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:46.489556 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1642e43f-4698-4cf5-b182-b825911c586d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:46.490159 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1642e43f-4698-4cf5-b182-b825911c586d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:46.555386 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9de6e350-f345-4560-ae6d-c087894e4259 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:46.578196 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9de6e350-f345-4560-ae6d-c087894e4259 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.246668 Jul 21 23:41:46.578935 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 222/412] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:46 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:46.597802 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-aef674d2-7b83-4b2a-88d8-77302a4c9954 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:46.598926 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-aef674d2-7b83-4b2a-88d8-77302a4c9954 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:46.605579 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aef674d2-7b83-4b2a-88d8-77302a4c9954 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:46.606499 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aef674d2-7b83-4b2a-88d8-77302a4c9954 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:46.606977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aef674d2-7b83-4b2a-88d8-77302a4c9954 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:46.613697 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aef674d2-7b83-4b2a-88d8-77302a4c9954 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:46.733826 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1642e43f-4698-4cf5-b182-b825911c586d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:46.742193 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1642e43f-4698-4cf5-b182-b825911c586d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:46.743953 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1642e43f-4698-4cf5-b182-b825911c586d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:46.746414 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1642e43f-4698-4cf5-b182-b825911c586d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.275927 Jul 21 23:41:46.747724 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 191/413] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:46 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:46.811459 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-aef674d2-7b83-4b2a-88d8-77302a4c9954 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:46.820318 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-aef674d2-7b83-4b2a-88d8-77302a4c9954 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.227540 Jul 21 23:41:46.821690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 223/414] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:46 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:47.595268 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ef9f442b-64f5-4c11-894b-20c3cf1dcfb1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:47.595934 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ef9f442b-64f5-4c11-894b-20c3cf1dcfb1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:47.597811 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:47.604216 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ef9f442b-64f5-4c11-894b-20c3cf1dcfb1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:47.605170 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ef9f442b-64f5-4c11-894b-20c3cf1dcfb1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:47.605967 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ef9f442b-64f5-4c11-894b-20c3cf1dcfb1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:47.606401 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ef9f442b-64f5-4c11-894b-20c3cf1dcfb1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:47.626202 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=8 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:47.752627 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ef9f442b-64f5-4c11-894b-20c3cf1dcfb1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:47.761773 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ef9f442b-64f5-4c11-894b-20c3cf1dcfb1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.170244 Jul 21 23:41:47.762353 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 192/415] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:47 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:47.767687 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-aae956a9-bac3-4e3e-844c-4cf26baaefef tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:47.768364 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-aae956a9-bac3-4e3e-844c-4cf26baaefef tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:47.775262 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aae956a9-bac3-4e3e-844c-4cf26baaefef tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:47.775829 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aae956a9-bac3-4e3e-844c-4cf26baaefef tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:47.777348 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aae956a9-bac3-4e3e-844c-4cf26baaefef tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:47.777853 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aae956a9-bac3-4e3e-844c-4cf26baaefef tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:47.839544 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f6d7b8cc-b6be-4ad2-8291-8587acddf80c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:47.840152 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f6d7b8cc-b6be-4ad2-8291-8587acddf80c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:47.846393 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f6d7b8cc-b6be-4ad2-8291-8587acddf80c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:47.846837 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f6d7b8cc-b6be-4ad2-8291-8587acddf80c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:47.847601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f6d7b8cc-b6be-4ad2-8291-8587acddf80c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:47.848032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f6d7b8cc-b6be-4ad2-8291-8587acddf80c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:47.948810 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-aae956a9-bac3-4e3e-844c-4cf26baaefef tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:47.958284 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-aae956a9-bac3-4e3e-844c-4cf26baaefef tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:47.960254 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-aae956a9-bac3-4e3e-844c-4cf26baaefef tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:47.961491 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-aae956a9-bac3-4e3e-844c-4cf26baaefef tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.197701 Jul 21 23:41:47.962182 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 224/416] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:47 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:48.014423 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f6d7b8cc-b6be-4ad2-8291-8587acddf80c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:48.022245 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f6d7b8cc-b6be-4ad2-8291-8587acddf80c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.187434 Jul 21 23:41:48.022927 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 193/417] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:47 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:48.779006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b286a30d-4e8e-4701-adb2-e8fbe9163982 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:48.779636 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b286a30d-4e8e-4701-adb2-e8fbe9163982 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:48.786585 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b286a30d-4e8e-4701-adb2-e8fbe9163982 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:48.787037 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b286a30d-4e8e-4701-adb2-e8fbe9163982 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:48.787816 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b286a30d-4e8e-4701-adb2-e8fbe9163982 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:48.788254 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b286a30d-4e8e-4701-adb2-e8fbe9163982 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:48.980035 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-593a932d-7b76-4737-b8b7-c4611f032d30 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:48.981335 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-593a932d-7b76-4737-b8b7-c4611f032d30 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:48.988693 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-593a932d-7b76-4737-b8b7-c4611f032d30 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:48.989478 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-593a932d-7b76-4737-b8b7-c4611f032d30 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:48.990433 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-593a932d-7b76-4737-b8b7-c4611f032d30 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:48.991018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-593a932d-7b76-4737-b8b7-c4611f032d30 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:49.188947 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b286a30d-4e8e-4701-adb2-e8fbe9163982 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:49.193079 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-593a932d-7b76-4737-b8b7-c4611f032d30 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:49.197874 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b286a30d-4e8e-4701-adb2-e8fbe9163982 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.422836 Jul 21 23:41:49.198867 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 225/418] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:48 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:49.202666 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-593a932d-7b76-4737-b8b7-c4611f032d30 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:49.203709 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a5200696-1e88-4e50-bef6-f3a4314c0ee1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:49.204160 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-593a932d-7b76-4737-b8b7-c4611f032d30 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:49.204580 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a5200696-1e88-4e50-bef6-f3a4314c0ee1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:49.209566 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-593a932d-7b76-4737-b8b7-c4611f032d30 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.229291 Jul 21 23:41:49.210726 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 194/419] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:48 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:49.214559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a5200696-1e88-4e50-bef6-f3a4314c0ee1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:49.215296 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a5200696-1e88-4e50-bef6-f3a4314c0ee1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:49.216328 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a5200696-1e88-4e50-bef6-f3a4314c0ee1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:49.216874 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a5200696-1e88-4e50-bef6-f3a4314c0ee1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:49.367718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a5200696-1e88-4e50-bef6-f3a4314c0ee1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:49.379907 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a5200696-1e88-4e50-bef6-f3a4314c0ee1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.179772 Jul 21 23:41:49.380609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 226/420] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:49 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:50.216119 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f2b7b93e-6dfc-4532-bbbc-79a48a546206 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:50.216731 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f2b7b93e-6dfc-4532-bbbc-79a48a546206 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:50.223374 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f2b7b93e-6dfc-4532-bbbc-79a48a546206 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:50.223828 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f2b7b93e-6dfc-4532-bbbc-79a48a546206 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:50.224611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f2b7b93e-6dfc-4532-bbbc-79a48a546206 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:50.225048 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f2b7b93e-6dfc-4532-bbbc-79a48a546206 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:50.230957 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6d2dfc20-5dd7-42be-b7fd-0da16665568b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:50.232338 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6d2dfc20-5dd7-42be-b7fd-0da16665568b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:50.240596 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d2dfc20-5dd7-42be-b7fd-0da16665568b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:50.241475 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d2dfc20-5dd7-42be-b7fd-0da16665568b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:50.243153 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d2dfc20-5dd7-42be-b7fd-0da16665568b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:50.243876 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d2dfc20-5dd7-42be-b7fd-0da16665568b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:50.405679 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6d2dfc20-5dd7-42be-b7fd-0da16665568b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:50.415079 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6d2dfc20-5dd7-42be-b7fd-0da16665568b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:50.417495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6d2dfc20-5dd7-42be-b7fd-0da16665568b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:50.420185 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6d2dfc20-5dd7-42be-b7fd-0da16665568b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.193823 Jul 21 23:41:50.422323 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f2b7b93e-6dfc-4532-bbbc-79a48a546206 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:50.425608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 227/421] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:50 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:50.431706 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5281c599-65c5-4920-bda0-e63e33fdcfd6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:50.433439 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5281c599-65c5-4920-bda0-e63e33fdcfd6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:50.437133 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f2b7b93e-6dfc-4532-bbbc-79a48a546206 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.225483 Jul 21 23:41:50.438104 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 195/422] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:50 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:50.448274 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5281c599-65c5-4920-bda0-e63e33fdcfd6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:50.449808 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5281c599-65c5-4920-bda0-e63e33fdcfd6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:50.450970 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5281c599-65c5-4920-bda0-e63e33fdcfd6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:50.451629 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5281c599-65c5-4920-bda0-e63e33fdcfd6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:50.602643 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5281c599-65c5-4920-bda0-e63e33fdcfd6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:50.610997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5281c599-65c5-4920-bda0-e63e33fdcfd6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.184185 Jul 21 23:41:50.611569 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 228/423] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:50 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:51.439258 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ba7eb98f-c6c2-4d72-b8a5-8b9cb404a03e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:51.439857 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ba7eb98f-c6c2-4d72-b8a5-8b9cb404a03e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:51.446178 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba7eb98f-c6c2-4d72-b8a5-8b9cb404a03e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:51.446612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba7eb98f-c6c2-4d72-b8a5-8b9cb404a03e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:51.447359 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba7eb98f-c6c2-4d72-b8a5-8b9cb404a03e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:51.448990 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba7eb98f-c6c2-4d72-b8a5-8b9cb404a03e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:51.454488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6545aaf8-c405-4cb5-91b1-90609d0f4d4e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:51.455125 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6545aaf8-c405-4cb5-91b1-90609d0f4d4e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:51.461654 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6545aaf8-c405-4cb5-91b1-90609d0f4d4e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:51.462099 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6545aaf8-c405-4cb5-91b1-90609d0f4d4e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:51.462860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6545aaf8-c405-4cb5-91b1-90609d0f4d4e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:51.463297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6545aaf8-c405-4cb5-91b1-90609d0f4d4e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:51.590104 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ba7eb98f-c6c2-4d72-b8a5-8b9cb404a03e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:51.599671 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ba7eb98f-c6c2-4d72-b8a5-8b9cb404a03e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:51.601250 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ba7eb98f-c6c2-4d72-b8a5-8b9cb404a03e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:51.602651 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ba7eb98f-c6c2-4d72-b8a5-8b9cb404a03e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.167299 Jul 21 23:41:51.603388 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 196/424] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:51 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:51.624856 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6545aaf8-c405-4cb5-91b1-90609d0f4d4e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:51.627601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-865f0f06-3b6f-4f70-b55b-d9d066b3b382 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:51.628231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-865f0f06-3b6f-4f70-b55b-d9d066b3b382 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:51.633096 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6545aaf8-c405-4cb5-91b1-90609d0f4d4e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.182331 Jul 21 23:41:51.633698 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 229/425] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:51 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:51.634124 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-865f0f06-3b6f-4f70-b55b-d9d066b3b382 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:51.634568 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-865f0f06-3b6f-4f70-b55b-d9d066b3b382 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:51.635921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-865f0f06-3b6f-4f70-b55b-d9d066b3b382 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:51.636355 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-865f0f06-3b6f-4f70-b55b-d9d066b3b382 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:51.777253 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-865f0f06-3b6f-4f70-b55b-d9d066b3b382 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:51.785604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-865f0f06-3b6f-4f70-b55b-d9d066b3b382 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.161462 Jul 21 23:41:51.786228 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 197/426] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:51 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:52.622302 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f8ededd6-2840-414d-bc58-958cb93e20d9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:52.623137 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f8ededd6-2840-414d-bc58-958cb93e20d9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:52.631342 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8ededd6-2840-414d-bc58-958cb93e20d9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:52.632288 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8ededd6-2840-414d-bc58-958cb93e20d9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:52.633591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8ededd6-2840-414d-bc58-958cb93e20d9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:52.634332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8ededd6-2840-414d-bc58-958cb93e20d9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:52.653257 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-cbfbbe0b-5379-4736-8d29-0f5b3193c3ae tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:52.654120 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-cbfbbe0b-5379-4736-8d29-0f5b3193c3ae tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:52.662885 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cbfbbe0b-5379-4736-8d29-0f5b3193c3ae tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:52.663330 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cbfbbe0b-5379-4736-8d29-0f5b3193c3ae tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:52.664099 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cbfbbe0b-5379-4736-8d29-0f5b3193c3ae tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:52.664537 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cbfbbe0b-5379-4736-8d29-0f5b3193c3ae tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:52.793082 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f8ededd6-2840-414d-bc58-958cb93e20d9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:52.803912 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f8ededd6-2840-414d-bc58-958cb93e20d9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:52.805525 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f8ededd6-2840-414d-bc58-958cb93e20d9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:52.806698 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f8ededd6-2840-414d-bc58-958cb93e20d9 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.189110 Jul 21 23:41:52.815812 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cbfbbe0b-5379-4736-8d29-0f5b3193c3ae tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:52.826104 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-cbfbbe0b-5379-4736-8d29-0f5b3193c3ae tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.178703 Jul 21 23:41:52.826934 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 198/427] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:52 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:52.827243 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 230/428] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:52 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:52.834990 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7c4d4302-7723-424f-90e3-494d998c0dfc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:52.835604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7c4d4302-7723-424f-90e3-494d998c0dfc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:52.841831 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7c4d4302-7723-424f-90e3-494d998c0dfc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:52.842275 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7c4d4302-7723-424f-90e3-494d998c0dfc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:52.843042 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7c4d4302-7723-424f-90e3-494d998c0dfc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:52.843474 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7c4d4302-7723-424f-90e3-494d998c0dfc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:52.848313 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=100 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:52.983682 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7c4d4302-7723-424f-90e3-494d998c0dfc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:52.991460 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7c4d4302-7723-424f-90e3-494d998c0dfc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.161093 Jul 21 23:41:52.992035 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 199/429] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:52 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:53.826009 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c701d3ae-22df-4afd-b0ff-4e57a1ff604c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:53.826611 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c701d3ae-22df-4afd-b0ff-4e57a1ff604c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:53.833029 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c701d3ae-22df-4afd-b0ff-4e57a1ff604c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:53.833482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c701d3ae-22df-4afd-b0ff-4e57a1ff604c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:53.834231 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c701d3ae-22df-4afd-b0ff-4e57a1ff604c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:53.834662 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c701d3ae-22df-4afd-b0ff-4e57a1ff604c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:53.845623 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e5869fbc-b998-4d2d-81fb-652b0808bb3d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:53.846299 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e5869fbc-b998-4d2d-81fb-652b0808bb3d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:53.852706 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e5869fbc-b998-4d2d-81fb-652b0808bb3d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:53.853156 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e5869fbc-b998-4d2d-81fb-652b0808bb3d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:53.854095 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e5869fbc-b998-4d2d-81fb-652b0808bb3d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:53.854569 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e5869fbc-b998-4d2d-81fb-652b0808bb3d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:53.987307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c701d3ae-22df-4afd-b0ff-4e57a1ff604c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:53.996599 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c701d3ae-22df-4afd-b0ff-4e57a1ff604c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:53.998323 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c701d3ae-22df-4afd-b0ff-4e57a1ff604c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:53.999518 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c701d3ae-22df-4afd-b0ff-4e57a1ff604c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.178001 Jul 21 23:41:54.000075 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 231/430] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:53 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:54.009503 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e5869fbc-b998-4d2d-81fb-652b0808bb3d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:54.013623 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b43b053c-64dd-46ca-ab5b-0f521801340a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:54.014262 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b43b053c-64dd-46ca-ab5b-0f521801340a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:54.018261 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e5869fbc-b998-4d2d-81fb-652b0808bb3d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.177010 Jul 21 23:41:54.018830 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 200/431] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:53 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:54.020195 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b43b053c-64dd-46ca-ab5b-0f521801340a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:54.020776 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b43b053c-64dd-46ca-ab5b-0f521801340a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:54.021596 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b43b053c-64dd-46ca-ab5b-0f521801340a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:54.022022 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b43b053c-64dd-46ca-ab5b-0f521801340a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:54.175934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b43b053c-64dd-46ca-ab5b-0f521801340a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:54.184619 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b43b053c-64dd-46ca-ab5b-0f521801340a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.179508 Jul 21 23:41:54.185546 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 232/432] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:54 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:55.018593 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-31f5d5bd-2af4-454b-98df-ff98c429fb61 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:55.019251 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-31f5d5bd-2af4-454b-98df-ff98c429fb61 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:55.026234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-31f5d5bd-2af4-454b-98df-ff98c429fb61 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:55.026774 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-31f5d5bd-2af4-454b-98df-ff98c429fb61 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:55.027536 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-31f5d5bd-2af4-454b-98df-ff98c429fb61 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:55.027966 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-31f5d5bd-2af4-454b-98df-ff98c429fb61 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:55.035741 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a26c8b7b-02da-4401-9c80-d81712164b35 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:55.036443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a26c8b7b-02da-4401-9c80-d81712164b35 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:55.043659 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a26c8b7b-02da-4401-9c80-d81712164b35 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:55.044107 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a26c8b7b-02da-4401-9c80-d81712164b35 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:55.044877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a26c8b7b-02da-4401-9c80-d81712164b35 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:55.045334 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a26c8b7b-02da-4401-9c80-d81712164b35 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:55.188991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-31f5d5bd-2af4-454b-98df-ff98c429fb61 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:55.200529 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-31f5d5bd-2af4-454b-98df-ff98c429fb61 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:55.202060 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-31f5d5bd-2af4-454b-98df-ff98c429fb61 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:55.204640 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-31f5d5bd-2af4-454b-98df-ff98c429fb61 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.188561 Jul 21 23:41:55.204640 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 201/433] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:55 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:55.208791 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-af70fd14-75ca-468f-a790-b40e7f3e7d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:55.209416 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-af70fd14-75ca-468f-a790-b40e7f3e7d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:55.210344 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a26c8b7b-02da-4401-9c80-d81712164b35 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:55.219463 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-af70fd14-75ca-468f-a790-b40e7f3e7d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:55.219885 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a26c8b7b-02da-4401-9c80-d81712164b35 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.187723 Jul 21 23:41:55.220012 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-af70fd14-75ca-468f-a790-b40e7f3e7d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:55.220478 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 233/434] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:55 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:55.220690 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-af70fd14-75ca-468f-a790-b40e7f3e7d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:55.221130 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-af70fd14-75ca-468f-a790-b40e7f3e7d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:55.357367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-af70fd14-75ca-468f-a790-b40e7f3e7d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:55.364712 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-af70fd14-75ca-468f-a790-b40e7f3e7d65 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.159558 Jul 21 23:41:55.365284 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 202/435] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:55 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:56.222332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c33cdcb2-2352-4749-89f0-ec56774dee08 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:56.222939 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c33cdcb2-2352-4749-89f0-ec56774dee08 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:56.229999 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c33cdcb2-2352-4749-89f0-ec56774dee08 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:56.230447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c33cdcb2-2352-4749-89f0-ec56774dee08 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:56.231209 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c33cdcb2-2352-4749-89f0-ec56774dee08 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:56.231731 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c33cdcb2-2352-4749-89f0-ec56774dee08 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:56.237792 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-12e39c69-5d34-48a9-a552-36175a432870 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:56.238424 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-12e39c69-5d34-48a9-a552-36175a432870 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:56.245272 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-12e39c69-5d34-48a9-a552-36175a432870 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:56.246244 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-12e39c69-5d34-48a9-a552-36175a432870 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:56.247021 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-12e39c69-5d34-48a9-a552-36175a432870 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:56.247456 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-12e39c69-5d34-48a9-a552-36175a432870 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:56.377323 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c33cdcb2-2352-4749-89f0-ec56774dee08 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:56.386315 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c33cdcb2-2352-4749-89f0-ec56774dee08 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:56.387824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c33cdcb2-2352-4749-89f0-ec56774dee08 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:56.388644 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-12e39c69-5d34-48a9-a552-36175a432870 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:56.388990 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c33cdcb2-2352-4749-89f0-ec56774dee08 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.170539 Jul 21 23:41:56.389595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 234/436] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:56 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:56.393942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4e309486-b782-46e1-a8e4-1311467f47a0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:56.394535 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4e309486-b782-46e1-a8e4-1311467f47a0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:56.397049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-12e39c69-5d34-48a9-a552-36175a432870 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.162992 Jul 21 23:41:56.400892 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e309486-b782-46e1-a8e4-1311467f47a0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:56.401378 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e309486-b782-46e1-a8e4-1311467f47a0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:56.401603 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 203/437] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:56 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:56.402143 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e309486-b782-46e1-a8e4-1311467f47a0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:56.402577 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e309486-b782-46e1-a8e4-1311467f47a0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:56.536692 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4e309486-b782-46e1-a8e4-1311467f47a0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:56.545167 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4e309486-b782-46e1-a8e4-1311467f47a0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.154596 Jul 21 23:41:56.545778 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 235/438] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:56 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:57.407293 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-dd8a95fa-4840-4aea-9d39-0c46d4c6cbba tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:57.407903 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-dd8a95fa-4840-4aea-9d39-0c46d4c6cbba tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:57.414481 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-694e0393-d9bc-4f73-aa1a-9c8f930ec623 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:57.414935 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dd8a95fa-4840-4aea-9d39-0c46d4c6cbba tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:57.415094 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-694e0393-d9bc-4f73-aa1a-9c8f930ec623 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:57.415206 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dd8a95fa-4840-4aea-9d39-0c46d4c6cbba tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:57.415936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dd8a95fa-4840-4aea-9d39-0c46d4c6cbba tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:57.416397 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-dd8a95fa-4840-4aea-9d39-0c46d4c6cbba tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:57.421829 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-694e0393-d9bc-4f73-aa1a-9c8f930ec623 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:57.422273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-694e0393-d9bc-4f73-aa1a-9c8f930ec623 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:57.423043 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-694e0393-d9bc-4f73-aa1a-9c8f930ec623 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:57.423474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-694e0393-d9bc-4f73-aa1a-9c8f930ec623 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:57.548294 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-dd8a95fa-4840-4aea-9d39-0c46d4c6cbba tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:57.552911 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-694e0393-d9bc-4f73-aa1a-9c8f930ec623 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:57.557081 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-dd8a95fa-4840-4aea-9d39-0c46d4c6cbba tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:57.558633 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-dd8a95fa-4840-4aea-9d39-0c46d4c6cbba tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:57.559797 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-dd8a95fa-4840-4aea-9d39-0c46d4c6cbba tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.156440 Jul 21 23:41:57.560346 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 204/439] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:57 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:57.561453 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-694e0393-d9bc-4f73-aa1a-9c8f930ec623 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.150659 Jul 21 23:41:57.562020 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 236/440] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:57 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:57.565781 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-273b728d-47de-4319-ac5d-296ea4a9ef03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:57.566384 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-273b728d-47de-4319-ac5d-296ea4a9ef03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:57.572872 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-273b728d-47de-4319-ac5d-296ea4a9ef03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:57.573348 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-273b728d-47de-4319-ac5d-296ea4a9ef03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:57.574111 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-273b728d-47de-4319-ac5d-296ea4a9ef03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:57.574539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-273b728d-47de-4319-ac5d-296ea4a9ef03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:57.704913 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-273b728d-47de-4319-ac5d-296ea4a9ef03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:57.712266 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-273b728d-47de-4319-ac5d-296ea4a9ef03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.150210 Jul 21 23:41:57.713455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 205/441] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:57 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:58.577966 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-33eb3572-56df-47e0-b547-631ebddba778 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:58.578562 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2bb2d3cd-ec8b-4100-9117-b06e701d8f84 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:58.578943 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-33eb3572-56df-47e0-b547-631ebddba778 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:58.579165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2bb2d3cd-ec8b-4100-9117-b06e701d8f84 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:58.585221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33eb3572-56df-47e0-b547-631ebddba778 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:58.585607 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2bb2d3cd-ec8b-4100-9117-b06e701d8f84 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:58.585726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33eb3572-56df-47e0-b547-631ebddba778 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:58.586084 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2bb2d3cd-ec8b-4100-9117-b06e701d8f84 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:58.586412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33eb3572-56df-47e0-b547-631ebddba778 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:58.586841 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-33eb3572-56df-47e0-b547-631ebddba778 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:58.586945 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2bb2d3cd-ec8b-4100-9117-b06e701d8f84 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:58.587272 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2bb2d3cd-ec8b-4100-9117-b06e701d8f84 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:58.726442 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-33eb3572-56df-47e0-b547-631ebddba778 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:58.726609 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2bb2d3cd-ec8b-4100-9117-b06e701d8f84 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:58.735813 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2bb2d3cd-ec8b-4100-9117-b06e701d8f84 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.161008 Jul 21 23:41:58.736073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-33eb3572-56df-47e0-b547-631ebddba778 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:58.736387 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 206/442] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:58 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:41:58.737735 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-33eb3572-56df-47e0-b547-631ebddba778 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:58.738886 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-33eb3572-56df-47e0-b547-631ebddba778 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.164813 Jul 21 23:41:58.739423 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 237/443] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:58 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:41:58.740823 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-89ed5b20-421a-44c3-898b-7f636153fe26 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:58.741463 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-89ed5b20-421a-44c3-898b-7f636153fe26 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:58.747690 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-89ed5b20-421a-44c3-898b-7f636153fe26 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:58.748137 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-89ed5b20-421a-44c3-898b-7f636153fe26 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:58.748901 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-89ed5b20-421a-44c3-898b-7f636153fe26 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:58.749367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-89ed5b20-421a-44c3-898b-7f636153fe26 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:58.879447 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-89ed5b20-421a-44c3-898b-7f636153fe26 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:58.886853 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-89ed5b20-421a-44c3-898b-7f636153fe26 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.149529 Jul 21 23:41:58.887406 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 207/444] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:58 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:59.753272 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-94cfc46f-35fe-41b3-b277-b5daa1f54d49 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:59.753910 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-94cfc46f-35fe-41b3-b277-b5daa1f54d49 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:59.757299 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-377415c9-1807-422f-ab1d-9ff77e8dfd7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:59.757906 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-377415c9-1807-422f-ab1d-9ff77e8dfd7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:59.761771 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-94cfc46f-35fe-41b3-b277-b5daa1f54d49 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:59.762386 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-94cfc46f-35fe-41b3-b277-b5daa1f54d49 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:59.763284 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-94cfc46f-35fe-41b3-b277-b5daa1f54d49 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:59.763883 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-94cfc46f-35fe-41b3-b277-b5daa1f54d49 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:59.764968 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-377415c9-1807-422f-ab1d-9ff77e8dfd7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:59.765452 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-377415c9-1807-422f-ab1d-9ff77e8dfd7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:59.766211 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-377415c9-1807-422f-ab1d-9ff77e8dfd7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:59.766645 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-377415c9-1807-422f-ab1d-9ff77e8dfd7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:59.896309 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-94cfc46f-35fe-41b3-b277-b5daa1f54d49 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:59.898806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:59.902426 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-377415c9-1807-422f-ab1d-9ff77e8dfd7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:59.906740 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-94cfc46f-35fe-41b3-b277-b5daa1f54d49 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.157362 Jul 21 23:41:59.907311 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 238/445] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:59 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:41:59.910893 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-377415c9-1807-422f-ab1d-9ff77e8dfd7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:59.911965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f3099a28-e490-4368-a9e5-603b3d63c03e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:41:59.912443 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-377415c9-1807-422f-ab1d-9ff77e8dfd7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:41:59.912572 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f3099a28-e490-4368-a9e5-603b3d63c03e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:41:59.914168 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-377415c9-1807-422f-ab1d-9ff77e8dfd7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.160797 Jul 21 23:41:59.914866 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 208/446] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:41:59 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:41:59.919324 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3099a28-e490-4368-a9e5-603b3d63c03e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:59.919767 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3099a28-e490-4368-a9e5-603b3d63c03e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:41:59.920556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3099a28-e490-4368-a9e5-603b3d63c03e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:41:59.920985 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f3099a28-e490-4368-a9e5-603b3d63c03e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:00.054990 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f3099a28-e490-4368-a9e5-603b3d63c03e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:00.062838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f3099a28-e490-4368-a9e5-603b3d63c03e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.154605 Jul 21 23:42:00.063404 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 239/447] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:41:59 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:00.923175 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-eee016b1-b96a-413c-84d9-a8fec0da4f5d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:00.923776 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-eee016b1-b96a-413c-84d9-a8fec0da4f5d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:00.930496 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-eee016b1-b96a-413c-84d9-a8fec0da4f5d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:00.930949 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-eee016b1-b96a-413c-84d9-a8fec0da4f5d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:00.932496 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-35532ce1-e65e-4e55-8014-eb88cd7c141e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:00.932997 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-eee016b1-b96a-413c-84d9-a8fec0da4f5d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:00.933100 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-eee016b1-b96a-413c-84d9-a8fec0da4f5d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:00.933232 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-35532ce1-e65e-4e55-8014-eb88cd7c141e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:00.939614 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-35532ce1-e65e-4e55-8014-eb88cd7c141e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:00.940063 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-35532ce1-e65e-4e55-8014-eb88cd7c141e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:00.940838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-35532ce1-e65e-4e55-8014-eb88cd7c141e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:00.941309 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-35532ce1-e65e-4e55-8014-eb88cd7c141e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:01.074566 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-eee016b1-b96a-413c-84d9-a8fec0da4f5d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:01.078365 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-35532ce1-e65e-4e55-8014-eb88cd7c141e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:01.086994 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-35532ce1-e65e-4e55-8014-eb88cd7c141e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:01.089064 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-35532ce1-e65e-4e55-8014-eb88cd7c141e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:01.090224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-35532ce1-e65e-4e55-8014-eb88cd7c141e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.162351 Jul 21 23:42:01.090768 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 240/448] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:00 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:42:01.091268 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-eee016b1-b96a-413c-84d9-a8fec0da4f5d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.172028 Jul 21 23:42:01.092177 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 209/449] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:00 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:01.095871 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b918d440-9a50-452d-b365-ff89f26efec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:01.099329 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b918d440-9a50-452d-b365-ff89f26efec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:01.106788 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b918d440-9a50-452d-b365-ff89f26efec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:01.107595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b918d440-9a50-452d-b365-ff89f26efec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:01.108713 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b918d440-9a50-452d-b365-ff89f26efec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:01.109583 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b918d440-9a50-452d-b365-ff89f26efec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:01.253052 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b918d440-9a50-452d-b365-ff89f26efec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:01.261156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b918d440-9a50-452d-b365-ff89f26efec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.169007 Jul 21 23:42:01.261741 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 241/450] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:01 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:02.108348 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-907274ca-49a5-4deb-8d0c-9090da1a86e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:02.108933 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-907274ca-49a5-4deb-8d0c-9090da1a86e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:02.115539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-907274ca-49a5-4deb-8d0c-9090da1a86e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:02.115985 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-907274ca-49a5-4deb-8d0c-9090da1a86e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:02.116743 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-907274ca-49a5-4deb-8d0c-9090da1a86e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:02.117087 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0caa66a0-258d-4ad2-9941-a7f938fb5003 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:02.117543 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-907274ca-49a5-4deb-8d0c-9090da1a86e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:02.117722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0caa66a0-258d-4ad2-9941-a7f938fb5003 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:02.124607 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0caa66a0-258d-4ad2-9941-a7f938fb5003 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:02.125047 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0caa66a0-258d-4ad2-9941-a7f938fb5003 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:02.125826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0caa66a0-258d-4ad2-9941-a7f938fb5003 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:02.126255 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0caa66a0-258d-4ad2-9941-a7f938fb5003 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:02.250911 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-907274ca-49a5-4deb-8d0c-9090da1a86e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:02.255503 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0caa66a0-258d-4ad2-9941-a7f938fb5003 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:02.260377 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-907274ca-49a5-4deb-8d0c-9090da1a86e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:02.265336 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0caa66a0-258d-4ad2-9941-a7f938fb5003 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1702 microversion: 2.1 time: 0.151906 Jul 21 23:42:02.265932 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 242/451] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:02 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1702 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:02.270555 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-907274ca-49a5-4deb-8d0c-9090da1a86e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:02.272013 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-907274ca-49a5-4deb-8d0c-9090da1a86e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.167527 Jul 21 23:42:02.272571 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 210/452] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:02 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:42:02.279107 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7be38387-b481-4f31-a576-dfe0b5178bcc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:02.279908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7be38387-b481-4f31-a576-dfe0b5178bcc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:02.281959 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-24db515f-1dfd-4a24-9ee5-bc0ad3718d74 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:02.286405 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7be38387-b481-4f31-a576-dfe0b5178bcc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:02.286910 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7be38387-b481-4f31-a576-dfe0b5178bcc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:02.287740 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7be38387-b481-4f31-a576-dfe0b5178bcc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:02.287847 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-24db515f-1dfd-4a24-9ee5-bc0ad3718d74 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:02.288294 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-24db515f-1dfd-4a24-9ee5-bc0ad3718d74 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:02.288392 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7be38387-b481-4f31-a576-dfe0b5178bcc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:02.348140 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-24db515f-1dfd-4a24-9ee5-bc0ad3718d74 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Going to try to start instance {{(pid=124387) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 23:42:02.392921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-24db515f-1dfd-4a24-9ee5-bc0ad3718d74 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "POST /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/action" status: 202 len: 0 microversion: 2.1 time: 0.114406 Jul 21 23:42:02.393765 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 211/453] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:42:02 2022] POST /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:42:02.402009 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-32175997-c360-4fd1-bfc5-3b1a26c1333b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:02.402709 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-32175997-c360-4fd1-bfc5-3b1a26c1333b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:02.408825 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-32175997-c360-4fd1-bfc5-3b1a26c1333b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:02.409314 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-32175997-c360-4fd1-bfc5-3b1a26c1333b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:02.410087 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-32175997-c360-4fd1-bfc5-3b1a26c1333b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:02.410531 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-32175997-c360-4fd1-bfc5-3b1a26c1333b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:02.430959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7be38387-b481-4f31-a576-dfe0b5178bcc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:02.439301 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7be38387-b481-4f31-a576-dfe0b5178bcc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.164614 Jul 21 23:42:02.439960 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 243/454] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:02 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:02.547585 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-32175997-c360-4fd1-bfc5-3b1a26c1333b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:02.555491 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-32175997-c360-4fd1-bfc5-3b1a26c1333b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1711 microversion: 2.1 time: 0.157653 Jul 21 23:42:02.556051 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 212/455] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:02 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1711 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:02.972333 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e3800668-8d2d-43ea-a6cd-9645e55757fc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:02.973481 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e3800668-8d2d-43ea-a6cd-9645e55757fc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:02.980106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3800668-8d2d-43ea-a6cd-9645e55757fc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:02.980554 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3800668-8d2d-43ea-a6cd-9645e55757fc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:02.981360 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3800668-8d2d-43ea-a6cd-9645e55757fc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:02.981791 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e3800668-8d2d-43ea-a6cd-9645e55757fc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.005543 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-e3800668-8d2d-43ea-a6cd-9645e55757fc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lazy-loading 'flavor' on Instance uuid c9b1ede1-a46a-454d-9b81-5b06de1124e9 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:42:03.073486 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9622e12f-beac-4fd1-9ad0-7b4153ca85dd tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:03.074179 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9622e12f-beac-4fd1-9ad0-7b4153ca85dd tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:03.081167 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9622e12f-beac-4fd1-9ad0-7b4153ca85dd tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.081730 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9622e12f-beac-4fd1-9ad0-7b4153ca85dd tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.082580 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9622e12f-beac-4fd1-9ad0-7b4153ca85dd tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.083097 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9622e12f-beac-4fd1-9ad0-7b4153ca85dd tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.108983 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9622e12f-beac-4fd1-9ad0-7b4153ca85dd tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e/ips" status: 200 len: 149 microversion: 2.1 time: 0.039684 Jul 21 23:42:03.110367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 213/456] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 23:42:03 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:42:03.122428 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d0e0bc23-18be-4c03-8e40-e845d7ef89d2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21021410-f25a-40a0-87ef-ae503129c704"}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:03.123912 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d0e0bc23-18be-4c03-8e40-e845d7ef89d2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:03.132340 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0e0bc23-18be-4c03-8e40-e845d7ef89d2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.132937 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0e0bc23-18be-4c03-8e40-e845d7ef89d2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.133864 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0e0bc23-18be-4c03-8e40-e845d7ef89d2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.134309 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d0e0bc23-18be-4c03-8e40-e845d7ef89d2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.145469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e3800668-8d2d-43ea-a6cd-9645e55757fc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "POST /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/action" status: 200 len: 32 microversion: 2.1 time: 0.177466 Jul 21 23:42:03.146125 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 244/457] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:42:02 2022] POST /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 23:42:03.156103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3dd41112-27ba-4deb-abff-92180f5c3670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:03.156805 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3dd41112-27ba-4deb-abff-92180f5c3670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:03.163131 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3dd41112-27ba-4deb-abff-92180f5c3670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.163587 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3dd41112-27ba-4deb-abff-92180f5c3670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.164384 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3dd41112-27ba-4deb-abff-92180f5c3670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.164805 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3dd41112-27ba-4deb-abff-92180f5c3670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.261459 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-d0e0bc23-18be-4c03-8e40-e845d7ef89d2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Invalid volume: volume 21021410-f25a-40a0-87ef-ae503129c704 is already attached to instances: 4395db50-179b-4591-bec9-a738ad477d31 Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d0e0bc23-18be-4c03-8e40-e845d7ef89d2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: POST /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e/os-volume_attachments HTTP/1.1 Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 74 Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:42:03.263199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {"volumeAttachment": {"volumeId": "21021410-f25a-40a0-87ef-ae503129c704"}} Jul 21 23:42:03.264611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Invalid volume: volume 21021410-f25a-40a0-87ef-ae503129c704 is already attached to instances: 4395db50-179b-4591-bec9-a738ad477d31 Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'server_id': 'd87a95f3-8058-423f-84d8-3bae1a4d760e', 'body': {'volumeAttachment': {'volumeId': '21021410-f25a-40a0-87ef-ae503129c704'}}} Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 21021410-f25a-40a0-87ef-ae503129c704 is already attached to instances: 4395db50-179b-4591-bec9-a738ad477d31 Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:03.265796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 21021410-f25a-40a0-87ef-ae503129c704 is already attached to instances: 4395db50-179b-4591-bec9-a738ad477d31 Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:03.267499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:42:03.268691 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:42:03.268691 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:42:03.268691 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:42:03.268691 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 21021410-f25a-40a0-87ef-ae503129c704 is already attached to instances: 4395db50-179b-4591-bec9-a738ad477d31 Jul 21 23:42:03.268691 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:03.270339 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d0e0bc23-18be-4c03-8e40-e845d7ef89d2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 400 to user: Invalid volume: volume 21021410-f25a-40a0-87ef-ae503129c704 is already attached to instances: 4395db50-179b-4591-bec9-a738ad477d31 {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:42:03.271432 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d0e0bc23-18be-4c03-8e40-e845d7ef89d2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.154777 Jul 21 23:42:03.277150 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 214/458] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:42:03 2022] POST /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e/os-volume_attachments => generated 174 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 23:42:03.282464 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5b9da3bc-b885-4ead-aa89-e709abb30fe1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:03.283260 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5b9da3bc-b885-4ead-aa89-e709abb30fe1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:03.290757 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5b9da3bc-b885-4ead-aa89-e709abb30fe1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.292687 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5b9da3bc-b885-4ead-aa89-e709abb30fe1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.294786 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5b9da3bc-b885-4ead-aa89-e709abb30fe1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.295271 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5b9da3bc-b885-4ead-aa89-e709abb30fe1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.299815 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:03.325361 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5b9da3bc-b885-4ead-aa89-e709abb30fe1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:42:03.384173 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3dd41112-27ba-4deb-abff-92180f5c3670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:03.393598 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3dd41112-27ba-4deb-abff-92180f5c3670 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.241486 Jul 21 23:42:03.396130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 245/459] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:03 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:03.402684 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ba64ba85-5179-436b-979f-13e621f2eb28 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:03.403595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ba64ba85-5179-436b-979f-13e621f2eb28 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:03.412617 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba64ba85-5179-436b-979f-13e621f2eb28 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.413362 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba64ba85-5179-436b-979f-13e621f2eb28 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.414293 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5b9da3bc-b885-4ead-aa89-e709abb30fe1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 204 len: 0 microversion: 2.1 time: 0.135199 Jul 21 23:42:03.414744 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba64ba85-5179-436b-979f-13e621f2eb28 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.415393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba64ba85-5179-436b-979f-13e621f2eb28 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.418773 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 215/460] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:42:03 2022] DELETE /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:42:03.426401 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1c4cbcbc-e4a7-44cd-8157-6f61063f38e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:03.427168 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1c4cbcbc-e4a7-44cd-8157-6f61063f38e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:03.433995 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c4cbcbc-e4a7-44cd-8157-6f61063f38e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.434158 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c4cbcbc-e4a7-44cd-8157-6f61063f38e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.434893 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c4cbcbc-e4a7-44cd-8157-6f61063f38e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.435515 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c4cbcbc-e4a7-44cd-8157-6f61063f38e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.567507 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ba64ba85-5179-436b-979f-13e621f2eb28 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:03.576706 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ba64ba85-5179-436b-979f-13e621f2eb28 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:03.578226 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ba64ba85-5179-436b-979f-13e621f2eb28 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:03.578441 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1c4cbcbc-e4a7-44cd-8157-6f61063f38e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:03.579391 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ba64ba85-5179-436b-979f-13e621f2eb28 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.181867 Jul 21 23:42:03.579950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 246/461] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:03 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:42:03.584273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-83c8524a-f20c-47e0-b0c1-176b1b2f6e51 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:03.584868 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-83c8524a-f20c-47e0-b0c1-176b1b2f6e51 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:03.586440 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1c4cbcbc-e4a7-44cd-8157-6f61063f38e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1681 microversion: 2.1 time: 0.166459 Jul 21 23:42:03.587001 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 216/462] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:03 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:03.591264 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83c8524a-f20c-47e0-b0c1-176b1b2f6e51 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.591783 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83c8524a-f20c-47e0-b0c1-176b1b2f6e51 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.592616 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83c8524a-f20c-47e0-b0c1-176b1b2f6e51 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.593119 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83c8524a-f20c-47e0-b0c1-176b1b2f6e51 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.600162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1205e2f4-4ddd-4e4a-91ef-76c8afb72b2e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:03.600769 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1205e2f4-4ddd-4e4a-91ef-76c8afb72b2e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:03.602687 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:03.609317 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1205e2f4-4ddd-4e4a-91ef-76c8afb72b2e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.609768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1205e2f4-4ddd-4e4a-91ef-76c8afb72b2e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.610536 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1205e2f4-4ddd-4e4a-91ef-76c8afb72b2e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:03.610971 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1205e2f4-4ddd-4e4a-91ef-76c8afb72b2e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:03.748741 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1205e2f4-4ddd-4e4a-91ef-76c8afb72b2e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:03.756763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1205e2f4-4ddd-4e4a-91ef-76c8afb72b2e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1711 microversion: 2.1 time: 0.160300 Jul 21 23:42:03.757353 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 217/463] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:03 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1711 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:03.779371 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-83c8524a-f20c-47e0-b0c1-176b1b2f6e51 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:03.787020 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-83c8524a-f20c-47e0-b0c1-176b1b2f6e51 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.206051 Jul 21 23:42:03.787529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 247/464] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:03 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:04.411974 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2e6dd995-d668-4033-9ee9-30044017337c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:04.412521 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2e6dd995-d668-4033-9ee9-30044017337c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:04.419013 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2e6dd995-d668-4033-9ee9-30044017337c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:04.419463 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2e6dd995-d668-4033-9ee9-30044017337c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:04.420222 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2e6dd995-d668-4033-9ee9-30044017337c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:04.420687 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2e6dd995-d668-4033-9ee9-30044017337c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:04.553384 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2e6dd995-d668-4033-9ee9-30044017337c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:04.561272 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2e6dd995-d668-4033-9ee9-30044017337c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.153177 Jul 21 23:42:04.561836 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 218/465] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:04 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:04.598631 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-16277b83-635f-4966-8d71-849658e804f8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:04.599239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-16277b83-635f-4966-8d71-849658e804f8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:04.603274 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b7713687-d668-4061-9b46-d89914e98bf5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:04.603878 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b7713687-d668-4061-9b46-d89914e98bf5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:04.607709 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-16277b83-635f-4966-8d71-849658e804f8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:04.608160 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-16277b83-635f-4966-8d71-849658e804f8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:04.608933 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-16277b83-635f-4966-8d71-849658e804f8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:04.609404 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-16277b83-635f-4966-8d71-849658e804f8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:04.611130 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b7713687-d668-4061-9b46-d89914e98bf5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:04.611576 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b7713687-d668-4061-9b46-d89914e98bf5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:04.612333 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b7713687-d668-4061-9b46-d89914e98bf5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:04.612763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b7713687-d668-4061-9b46-d89914e98bf5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:04.742679 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b7713687-d668-4061-9b46-d89914e98bf5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:04.747705 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-16277b83-635f-4966-8d71-849658e804f8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:04.751608 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b7713687-d668-4061-9b46-d89914e98bf5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1681 microversion: 2.1 time: 0.151968 Jul 21 23:42:04.752178 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 219/466] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:04 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:04.756077 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-16277b83-635f-4966-8d71-849658e804f8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:04.757610 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-16277b83-635f-4966-8d71-849658e804f8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:04.758767 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-16277b83-635f-4966-8d71-849658e804f8 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.164041 Jul 21 23:42:04.759323 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 248/467] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:04 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:42:04.774332 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-895b0977-18a9-4191-a410-3547b4cbc981 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:04.774934 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-895b0977-18a9-4191-a410-3547b4cbc981 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:04.780868 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-895b0977-18a9-4191-a410-3547b4cbc981 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:04.781344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-895b0977-18a9-4191-a410-3547b4cbc981 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:04.782101 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-895b0977-18a9-4191-a410-3547b4cbc981 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:04.782536 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-895b0977-18a9-4191-a410-3547b4cbc981 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:04.803365 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-87de1013-6708-45af-aa7f-6b3b1eebb93a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:04.803974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-87de1013-6708-45af-aa7f-6b3b1eebb93a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:04.810526 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-87de1013-6708-45af-aa7f-6b3b1eebb93a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:04.810979 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-87de1013-6708-45af-aa7f-6b3b1eebb93a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:04.811748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-87de1013-6708-45af-aa7f-6b3b1eebb93a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:04.812187 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-87de1013-6708-45af-aa7f-6b3b1eebb93a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:04.917546 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-895b0977-18a9-4191-a410-3547b4cbc981 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:04.925901 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-895b0977-18a9-4191-a410-3547b4cbc981 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1711 microversion: 2.1 time: 0.155196 Jul 21 23:42:04.926465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 220/468] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:04 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1711 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:04.953462 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-87de1013-6708-45af-aa7f-6b3b1eebb93a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:04.960892 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-87de1013-6708-45af-aa7f-6b3b1eebb93a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.161331 Jul 21 23:42:04.961698 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 249/469] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:04 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:05.548681 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-626e3bba-9215-4157-abee-a96a5ffeb8d7 req-32c76455-1861-4677-bb9c-accbc67f768e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1b0372-60fe-4345-9668-12276af08fda", "name": "network-vif-plugged", "status": "completed", "tag": "3fba9807-20fe-41d5-8c1a-0473403d7805"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:05.558960 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-626e3bba-9215-4157-abee-a96a5ffeb8d7 req-32c76455-1861-4677-bb9c-accbc67f768e service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:05.559538 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-626e3bba-9215-4157-abee-a96a5ffeb8d7 req-32c76455-1861-4677-bb9c-accbc67f768e service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:05.572638 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-626e3bba-9215-4157-abee-a96a5ffeb8d7 req-32c76455-1861-4677-bb9c-accbc67f768e service nova] Creating event network-vif-plugged:3fba9807-20fe-41d5-8c1a-0473403d7805 for instance fc1b0372-60fe-4345-9668-12276af08fda on hv-cinder-85070 Jul 21 23:42:05.577950 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-626e3bba-9215-4157-abee-a96a5ffeb8d7 req-32c76455-1861-4677-bb9c-accbc67f768e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032935 Jul 21 23:42:05.578552 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-14749f87-435e-45f1-9838-d12ec631e3cd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:05.578729 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 221/470] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:05.579488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-14749f87-435e-45f1-9838-d12ec631e3cd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:05.585603 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14749f87-435e-45f1-9838-d12ec631e3cd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:05.586046 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14749f87-435e-45f1-9838-d12ec631e3cd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:05.586817 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14749f87-435e-45f1-9838-d12ec631e3cd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:05.587248 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14749f87-435e-45f1-9838-d12ec631e3cd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:05.721609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-14749f87-435e-45f1-9838-d12ec631e3cd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:05.730043 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-14749f87-435e-45f1-9838-d12ec631e3cd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.154852 Jul 21 23:42:05.730731 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 250/471] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:05 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:05.770327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-cbed658e-77e7-40ce-9615-5b5cbba78f13 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:05.771093 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-cbed658e-77e7-40ce-9615-5b5cbba78f13 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:05.776325 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9d33e8c4-f216-48a8-bd6e-211d5060fcbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:05.777016 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9d33e8c4-f216-48a8-bd6e-211d5060fcbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:05.777535 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cbed658e-77e7-40ce-9615-5b5cbba78f13 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:05.777990 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cbed658e-77e7-40ce-9615-5b5cbba78f13 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:05.778764 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cbed658e-77e7-40ce-9615-5b5cbba78f13 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:05.779203 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cbed658e-77e7-40ce-9615-5b5cbba78f13 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:05.783269 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d33e8c4-f216-48a8-bd6e-211d5060fcbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:05.783800 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d33e8c4-f216-48a8-bd6e-211d5060fcbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:05.784626 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d33e8c4-f216-48a8-bd6e-211d5060fcbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:05.785065 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9d33e8c4-f216-48a8-bd6e-211d5060fcbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:05.919749 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cbed658e-77e7-40ce-9615-5b5cbba78f13 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:05.929212 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-cbed658e-77e7-40ce-9615-5b5cbba78f13 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1681 microversion: 2.1 time: 0.163138 Jul 21 23:42:05.933230 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 222/472] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:05 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:05.947654 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9d33e8c4-f216-48a8-bd6e-211d5060fcbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:05.956260 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-302024f9-da76-4f95-842c-965f47506ae0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:05.958025 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9d33e8c4-f216-48a8-bd6e-211d5060fcbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:05.958871 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-302024f9-da76-4f95-842c-965f47506ae0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:05.970413 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-302024f9-da76-4f95-842c-965f47506ae0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:05.977081 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-302024f9-da76-4f95-842c-965f47506ae0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:05.977638 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-302024f9-da76-4f95-842c-965f47506ae0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:05.978270 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-302024f9-da76-4f95-842c-965f47506ae0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:05.980055 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9d33e8c4-f216-48a8-bd6e-211d5060fcbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:05.985755 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9d33e8c4-f216-48a8-bd6e-211d5060fcbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.211494 Jul 21 23:42:05.988143 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 251/473] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:05 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:42:05.998986 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-69804d50-7056-49b8-893d-94f8f50d6c03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:06.001325 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-69804d50-7056-49b8-893d-94f8f50d6c03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:06.018296 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69804d50-7056-49b8-893d-94f8f50d6c03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:06.018545 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69804d50-7056-49b8-893d-94f8f50d6c03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:06.019146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69804d50-7056-49b8-893d-94f8f50d6c03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:06.019594 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69804d50-7056-49b8-893d-94f8f50d6c03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:06.293762 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-302024f9-da76-4f95-842c-965f47506ae0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:06.314972 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-302024f9-da76-4f95-842c-965f47506ae0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1715 microversion: 2.1 time: 0.374259 Jul 21 23:42:06.316118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 223/474] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:05 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1715 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:06.322325 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-69804d50-7056-49b8-893d-94f8f50d6c03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:06.344615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-69804d50-7056-49b8-893d-94f8f50d6c03 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.352200 Jul 21 23:42:06.345046 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 252/475] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:05 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:06.748476 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-28d1fd13-c110-4750-825a-9c1816d7de3f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:06.749087 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-28d1fd13-c110-4750-825a-9c1816d7de3f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:06.756271 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28d1fd13-c110-4750-825a-9c1816d7de3f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:06.756720 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28d1fd13-c110-4750-825a-9c1816d7de3f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:06.757553 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28d1fd13-c110-4750-825a-9c1816d7de3f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:06.758048 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28d1fd13-c110-4750-825a-9c1816d7de3f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:06.946383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-53bc18a7-672b-44db-8461-2e1d24ff8517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:06.947002 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-53bc18a7-672b-44db-8461-2e1d24ff8517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:06.950268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=90 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:06.955912 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53bc18a7-672b-44db-8461-2e1d24ff8517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:06.956634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53bc18a7-672b-44db-8461-2e1d24ff8517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:06.957646 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53bc18a7-672b-44db-8461-2e1d24ff8517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:06.958271 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53bc18a7-672b-44db-8461-2e1d24ff8517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:06.975995 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:07.031588 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-53bc18a7-672b-44db-8461-2e1d24ff8517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:07.040604 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-53bc18a7-672b-44db-8461-2e1d24ff8517 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1614 microversion: 2.1 time: 0.097893 Jul 21 23:42:07.041268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 253/476] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:06 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:07.047466 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2216839b-10e4-4db7-ae31-82375616c5c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:07.048578 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2216839b-10e4-4db7-ae31-82375616c5c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:07.056150 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2216839b-10e4-4db7-ae31-82375616c5c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:07.056604 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2216839b-10e4-4db7-ae31-82375616c5c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:07.058021 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2216839b-10e4-4db7-ae31-82375616c5c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:07.058500 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2216839b-10e4-4db7-ae31-82375616c5c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:07.230735 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2216839b-10e4-4db7-ae31-82375616c5c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:07.239953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2216839b-10e4-4db7-ae31-82375616c5c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:07.241526 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2216839b-10e4-4db7-ae31-82375616c5c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:07.242731 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2216839b-10e4-4db7-ae31-82375616c5c5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.199700 Jul 21 23:42:07.243506 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 254/477] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:07 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:42:07.271424 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-28d1fd13-c110-4750-825a-9c1816d7de3f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:07.279903 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-28d1fd13-c110-4750-825a-9c1816d7de3f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.536242 Jul 21 23:42:07.280774 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 224/478] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:06 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:07.363966 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-65934699-7563-44d4-a8cf-b240db7578b6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:07.364642 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-65934699-7563-44d4-a8cf-b240db7578b6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:07.372102 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-65934699-7563-44d4-a8cf-b240db7578b6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:07.372806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-65934699-7563-44d4-a8cf-b240db7578b6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:07.373777 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-65934699-7563-44d4-a8cf-b240db7578b6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:07.374373 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-65934699-7563-44d4-a8cf-b240db7578b6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:07.490177 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-479021ce-f801-4702-b027-1382a4e4f141 req-66555755-ae10-4b90-880d-bdfee1ebe527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87a95f3-8058-423f-84d8-3bae1a4d760e", "name": "network-vif-deleted", "tag": "1a6602da-da0f-4996-b2b6-eee0aef35fef"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:07.500825 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-479021ce-f801-4702-b027-1382a4e4f141 req-66555755-ae10-4b90-880d-bdfee1ebe527 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:07.501457 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-479021ce-f801-4702-b027-1382a4e4f141 req-66555755-ae10-4b90-880d-bdfee1ebe527 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:07.514333 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-479021ce-f801-4702-b027-1382a4e4f141 req-66555755-ae10-4b90-880d-bdfee1ebe527 service nova] Creating event network-vif-deleted:1a6602da-da0f-4996-b2b6-eee0aef35fef for instance d87a95f3-8058-423f-84d8-3bae1a4d760e on hv-cinder-85070 Jul 21 23:42:07.519690 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-479021ce-f801-4702-b027-1382a4e4f141 req-66555755-ae10-4b90-880d-bdfee1ebe527 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035568 Jul 21 23:42:07.520693 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 225/479] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:42:07.568189 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-65934699-7563-44d4-a8cf-b240db7578b6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:07.577723 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-65934699-7563-44d4-a8cf-b240db7578b6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1265 microversion: 2.1 time: 0.217453 Jul 21 23:42:07.578409 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 255/480] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:07 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:07.595954 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-01fe1174-1d80-40ef-8e20-4dacfed868d1 req-1045f247-1eb4-448f-9d29-cc839635afd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1e0d18-427a-456e-8ca0-c246e41f1fab", "name": "network-vif-plugged", "status": "completed", "tag": "7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:07.605615 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-01fe1174-1d80-40ef-8e20-4dacfed868d1 req-1045f247-1eb4-448f-9d29-cc839635afd0 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:07.606076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-01fe1174-1d80-40ef-8e20-4dacfed868d1 req-1045f247-1eb4-448f-9d29-cc839635afd0 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:07.617479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-01fe1174-1d80-40ef-8e20-4dacfed868d1 req-1045f247-1eb4-448f-9d29-cc839635afd0 service nova] Creating event network-vif-plugged:7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8 for instance eb1e0d18-427a-456e-8ca0-c246e41f1fab on hv-cinder-85070 Jul 21 23:42:07.623079 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-01fe1174-1d80-40ef-8e20-4dacfed868d1 req-1045f247-1eb4-448f-9d29-cc839635afd0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031347 Jul 21 23:42:07.623664 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 226/481] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:08.059389 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d4ce33d9-64ce-4052-81bb-5c1d443c4223 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:08.060003 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d4ce33d9-64ce-4052-81bb-5c1d443c4223 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:08.067066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4ce33d9-64ce-4052-81bb-5c1d443c4223 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:08.067511 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4ce33d9-64ce-4052-81bb-5c1d443c4223 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:08.068437 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4ce33d9-64ce-4052-81bb-5c1d443c4223 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:08.068712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4ce33d9-64ce-4052-81bb-5c1d443c4223 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:08.100379 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4ce33d9-64ce-4052-81bb-5c1d443c4223 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:08.100833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d4ce33d9-64ce-4052-81bb-5c1d443c4223 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:08.101320 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-d4ce33d9-64ce-4052-81bb-5c1d443c4223 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lazy-loading 'fault' on Instance uuid d87a95f3-8058-423f-84d8-3bae1a4d760e {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:42:08.143512 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d4ce33d9-64ce-4052-81bb-5c1d443c4223 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:08.151838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d4ce33d9-64ce-4052-81bb-5c1d443c4223 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 200 len: 1332 microversion: 2.1 time: 0.096524 Jul 21 23:42:08.152416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 256/482] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:08 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:08.266136 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4a840aa1-b422-4332-86f8-7a944a7128db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:08.266837 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4a840aa1-b422-4332-86f8-7a944a7128db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:08.273331 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4a840aa1-b422-4332-86f8-7a944a7128db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:08.273778 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4a840aa1-b422-4332-86f8-7a944a7128db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:08.274559 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4a840aa1-b422-4332-86f8-7a944a7128db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:08.274989 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4a840aa1-b422-4332-86f8-7a944a7128db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:08.297553 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-aedc09a3-8927-4e21-9d7c-02a6e3c6d547 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:08.298414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-aedc09a3-8927-4e21-9d7c-02a6e3c6d547 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:08.307899 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aedc09a3-8927-4e21-9d7c-02a6e3c6d547 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:08.309167 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aedc09a3-8927-4e21-9d7c-02a6e3c6d547 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:08.310193 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aedc09a3-8927-4e21-9d7c-02a6e3c6d547 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:08.310653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aedc09a3-8927-4e21-9d7c-02a6e3c6d547 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:08.434297 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4a840aa1-b422-4332-86f8-7a944a7128db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:08.446372 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4a840aa1-b422-4332-86f8-7a944a7128db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:08.449648 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4a840aa1-b422-4332-86f8-7a944a7128db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:08.451060 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4a840aa1-b422-4332-86f8-7a944a7128db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.193209 Jul 21 23:42:08.462668 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 227/483] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:08 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:42:08.472963 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-aedc09a3-8927-4e21-9d7c-02a6e3c6d547 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:08.482500 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-aedc09a3-8927-4e21-9d7c-02a6e3c6d547 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.188571 Jul 21 23:42:08.483071 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 257/484] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:08 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:08.596415 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-05844505-0c94-4ed7-8bd6-36cf0c69888e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:08.597041 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-05844505-0c94-4ed7-8bd6-36cf0c69888e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:08.603465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-05844505-0c94-4ed7-8bd6-36cf0c69888e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:08.604669 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-05844505-0c94-4ed7-8bd6-36cf0c69888e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:08.605631 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-05844505-0c94-4ed7-8bd6-36cf0c69888e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:08.606227 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-05844505-0c94-4ed7-8bd6-36cf0c69888e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:08.754591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-05844505-0c94-4ed7-8bd6-36cf0c69888e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:08.762293 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-05844505-0c94-4ed7-8bd6-36cf0c69888e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1453 microversion: 2.1 time: 0.171114 Jul 21 23:42:08.762936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 228/485] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:08 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:08.779539 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-975e204b-a4e1-4da3-a038-941bf39c6985 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:08.780069 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-975e204b-a4e1-4da3-a038-941bf39c6985 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:08.786144 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-975e204b-a4e1-4da3-a038-941bf39c6985 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:08.786587 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-975e204b-a4e1-4da3-a038-941bf39c6985 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:08.787330 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-975e204b-a4e1-4da3-a038-941bf39c6985 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:08.787756 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-975e204b-a4e1-4da3-a038-941bf39c6985 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:08.934686 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-975e204b-a4e1-4da3-a038-941bf39c6985 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:08.943297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-975e204b-a4e1-4da3-a038-941bf39c6985 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1453 microversion: 2.1 time: 0.168185 Jul 21 23:42:08.944352 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 258/486] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:08 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:09.168597 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ce3fe829-2f74-47fd-b6f9-349ec977d4e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:09.169663 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ce3fe829-2f74-47fd-b6f9-349ec977d4e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:09.175836 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ce3fe829-2f74-47fd-b6f9-349ec977d4e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:09.176287 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ce3fe829-2f74-47fd-b6f9-349ec977d4e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:09.177052 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ce3fe829-2f74-47fd-b6f9-349ec977d4e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:09.177723 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ce3fe829-2f74-47fd-b6f9-349ec977d4e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:09.191798 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-ce3fe829-2f74-47fd-b6f9-349ec977d4e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ce3fe829-2f74-47fd-b6f9-349ec977d4e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e HTTP/1.1 Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:42:09.193650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:42:09.195032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': 'd87a95f3-8058-423f-84d8-3bae1a4d760e'} Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:42:09.195759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:42:09.197106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:09.198990 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ce3fe829-2f74-47fd-b6f9-349ec977d4e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:42:09.198990 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ce3fe829-2f74-47fd-b6f9-349ec977d4e0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 404 len: 111 microversion: 2.1 time: 0.031076 Jul 21 23:42:09.199549 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 229/487] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:09 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:42:09.204904 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-03942272-2b6d-4765-aca0-7a66dabfb72d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '.version_select at 0x7f7d28c84ee0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:09.225815 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-03942272-2b6d-4765-aca0-7a66dabfb72d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387581402" status: 202 len: 0 microversion: 2.1 time: 0.025159 Jul 21 23:42:09.226400 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 259/488] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jul 21 23:42:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387581402 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:42:09.470502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2956fe32-e167-4de9-a50a-a555a1938cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:09.472343 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2956fe32-e167-4de9-a50a-a555a1938cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:09.483144 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2956fe32-e167-4de9-a50a-a555a1938cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:09.483932 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2956fe32-e167-4de9-a50a-a555a1938cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:09.484908 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2956fe32-e167-4de9-a50a-a555a1938cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:09.486151 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2956fe32-e167-4de9-a50a-a555a1938cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:09.500074 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-50d1f8c8-9264-4bee-8cd0-4c81294d13c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:09.501302 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-50d1f8c8-9264-4bee-8cd0-4c81294d13c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:09.511680 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-50d1f8c8-9264-4bee-8cd0-4c81294d13c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:09.512535 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-50d1f8c8-9264-4bee-8cd0-4c81294d13c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:09.515437 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-50d1f8c8-9264-4bee-8cd0-4c81294d13c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:09.516122 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-50d1f8c8-9264-4bee-8cd0-4c81294d13c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:09.738482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-50d1f8c8-9264-4bee-8cd0-4c81294d13c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:09.739267 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2956fe32-e167-4de9-a50a-a555a1938cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:09.756962 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-50d1f8c8-9264-4bee-8cd0-4c81294d13c8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.260663 Jul 21 23:42:09.764054 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 260/489] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:09 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:09.774836 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2956fe32-e167-4de9-a50a-a555a1938cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:09.777229 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2956fe32-e167-4de9-a50a-a555a1938cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:09.778599 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2956fe32-e167-4de9-a50a-a555a1938cc5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.312594 Jul 21 23:42:09.780492 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 230/490] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:09 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:42:10.057152 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2e80e919-df11-47c8-9532-9e1854915f77 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:10.057699 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2e80e919-df11-47c8-9532-9e1854915f77 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:10.063668 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2e80e919-df11-47c8-9532-9e1854915f77 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:10.064117 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2e80e919-df11-47c8-9532-9e1854915f77 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:10.064883 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2e80e919-df11-47c8-9532-9e1854915f77 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:10.065349 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2e80e919-df11-47c8-9532-9e1854915f77 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:10.202177 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-2e80e919-df11-47c8-9532-9e1854915f77 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lazy-loading 'services' on Instance uuid 4395db50-179b-4591-bec9-a738ad477d31 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:42:10.333549 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2e80e919-df11-47c8-9532-9e1854915f77 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-volume_attachments/21021410-f25a-40a0-87ef-ae503129c704" status: 202 len: 0 microversion: 2.1 time: 0.280076 Jul 21 23:42:10.334912 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 261/491] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:42:10 2022] DELETE /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-volume_attachments/21021410-f25a-40a0-87ef-ae503129c704 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:42:10.344525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-07a03995-c808-42ba-a8d8-95860941dadc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:10.346354 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-07a03995-c808-42ba-a8d8-95860941dadc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:10.353167 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-07a03995-c808-42ba-a8d8-95860941dadc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:10.353653 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-07a03995-c808-42ba-a8d8-95860941dadc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:10.355164 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-07a03995-c808-42ba-a8d8-95860941dadc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:10.355690 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-07a03995-c808-42ba-a8d8-95860941dadc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:10.386143 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-07a03995-c808-42ba-a8d8-95860941dadc tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045939 Jul 21 23:42:10.386798 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 231/492] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:42:10 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:10.775696 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-713f0fc3-99e5-4bf3-b304-25f80137fca3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:10.777579 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-713f0fc3-99e5-4bf3-b304-25f80137fca3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:10.783726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-713f0fc3-99e5-4bf3-b304-25f80137fca3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:10.784167 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-713f0fc3-99e5-4bf3-b304-25f80137fca3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:10.784932 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-713f0fc3-99e5-4bf3-b304-25f80137fca3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:10.785400 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-713f0fc3-99e5-4bf3-b304-25f80137fca3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:10.799732 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0cbadd43-e232-4ac1-81d0-48b87d58f396 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:10.800436 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0cbadd43-e232-4ac1-81d0-48b87d58f396 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:10.806859 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0cbadd43-e232-4ac1-81d0-48b87d58f396 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:10.807552 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0cbadd43-e232-4ac1-81d0-48b87d58f396 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:10.808574 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0cbadd43-e232-4ac1-81d0-48b87d58f396 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:10.809243 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0cbadd43-e232-4ac1-81d0-48b87d58f396 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:10.986976 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-713f0fc3-99e5-4bf3-b304-25f80137fca3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:11.002741 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-713f0fc3-99e5-4bf3-b304-25f80137fca3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.231100 Jul 21 23:42:11.013374 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 262/493] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:10 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:11.013374 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-411ce7f4-628a-494d-8e15-038f7492a13d req-59ba9efe-182e-4305-baf3-3ebb91cc0b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1b0372-60fe-4345-9668-12276af08fda", "tag": "3fba9807-20fe-41d5-8c1a-0473403d7805"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:11.019545 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-411ce7f4-628a-494d-8e15-038f7492a13d req-59ba9efe-182e-4305-baf3-3ebb91cc0b4b service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:11.020086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-411ce7f4-628a-494d-8e15-038f7492a13d req-59ba9efe-182e-4305-baf3-3ebb91cc0b4b service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:11.038789 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0cbadd43-e232-4ac1-81d0-48b87d58f396 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:11.039902 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-411ce7f4-628a-494d-8e15-038f7492a13d req-59ba9efe-182e-4305-baf3-3ebb91cc0b4b service nova] Creating event network-changed:3fba9807-20fe-41d5-8c1a-0473403d7805 for instance fc1b0372-60fe-4345-9668-12276af08fda on hv-cinder-85070 Jul 21 23:42:11.043537 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:11.048973 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-411ce7f4-628a-494d-8e15-038f7492a13d req-59ba9efe-182e-4305-baf3-3ebb91cc0b4b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043511 Jul 21 23:42:11.049781 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 263/494] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:11.052197 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0cbadd43-e232-4ac1-81d0-48b87d58f396 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:11.053923 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0cbadd43-e232-4ac1-81d0-48b87d58f396 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:11.055308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0cbadd43-e232-4ac1-81d0-48b87d58f396 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1807 microversion: 2.20 time: 0.260343 Jul 21 23:42:11.056228 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 232/495] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:10 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1807 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:42:11.398450 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-410a0ad9-8626-4c5e-9793-afcd8ec0b8ca tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:11.399609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-410a0ad9-8626-4c5e-9793-afcd8ec0b8ca tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:11.406495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-410a0ad9-8626-4c5e-9793-afcd8ec0b8ca tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:11.406972 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-410a0ad9-8626-4c5e-9793-afcd8ec0b8ca tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:11.407714 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-410a0ad9-8626-4c5e-9793-afcd8ec0b8ca tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:11.408179 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-410a0ad9-8626-4c5e-9793-afcd8ec0b8ca tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:11.444137 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-410a0ad9-8626-4c5e-9793-afcd8ec0b8ca tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050739 Jul 21 23:42:11.444626 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 264/496] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:42:11 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:12.021554 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e594d0b0-a815-4010-9bbe-7ebee6d3ee59 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:12.022611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e594d0b0-a815-4010-9bbe-7ebee6d3ee59 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:12.032160 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e594d0b0-a815-4010-9bbe-7ebee6d3ee59 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:12.032753 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e594d0b0-a815-4010-9bbe-7ebee6d3ee59 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:12.033665 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e594d0b0-a815-4010-9bbe-7ebee6d3ee59 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:12.034211 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e594d0b0-a815-4010-9bbe-7ebee6d3ee59 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:12.075296 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-39f79311-1546-4e7a-b12c-29e83254a5e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:12.075961 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-39f79311-1546-4e7a-b12c-29e83254a5e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:12.082427 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39f79311-1546-4e7a-b12c-29e83254a5e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:12.082871 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39f79311-1546-4e7a-b12c-29e83254a5e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:12.083838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39f79311-1546-4e7a-b12c-29e83254a5e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:12.086760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-39f79311-1546-4e7a-b12c-29e83254a5e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:12.214468 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e594d0b0-a815-4010-9bbe-7ebee6d3ee59 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:12.224143 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e594d0b0-a815-4010-9bbe-7ebee6d3ee59 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.206792 Jul 21 23:42:12.225302 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 233/497] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:12 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:12.257350 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-39f79311-1546-4e7a-b12c-29e83254a5e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:12.266430 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-39f79311-1546-4e7a-b12c-29e83254a5e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:12.267935 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-39f79311-1546-4e7a-b12c-29e83254a5e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:12.269109 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-39f79311-1546-4e7a-b12c-29e83254a5e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1794 microversion: 2.20 time: 0.199013 Jul 21 23:42:12.269706 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 265/498] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:12 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1794 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:42:12.457981 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-59f09c9d-8474-4d60-9883-a522cd70781a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:12.458957 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-59f09c9d-8474-4d60-9883-a522cd70781a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:12.466214 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-59f09c9d-8474-4d60-9883-a522cd70781a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:12.466656 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-59f09c9d-8474-4d60-9883-a522cd70781a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:12.467423 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-59f09c9d-8474-4d60-9883-a522cd70781a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:12.467854 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-59f09c9d-8474-4d60-9883-a522cd70781a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:12.497767 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-59f09c9d-8474-4d60-9883-a522cd70781a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043727 Jul 21 23:42:12.498320 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 234/499] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:42:12 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:42:12.553591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-02046801-22ac-42cd-9098-95a328560beb tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:12.554087 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-02046801-22ac-42cd-9098-95a328560beb tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:12.561321 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-02046801-22ac-42cd-9098-95a328560beb tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:12.561763 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-02046801-22ac-42cd-9098-95a328560beb tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:12.562519 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-02046801-22ac-42cd-9098-95a328560beb tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:12.562950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-02046801-22ac-42cd-9098-95a328560beb tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:12.587003 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-02046801-22ac-42cd-9098-95a328560beb tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:42:12.672438 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-02046801-22ac-42cd-9098-95a328560beb tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 204 len: 0 microversion: 2.1 time: 0.122375 Jul 21 23:42:12.673025 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 266/500] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:42:12 2022] DELETE /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:42:12.681147 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-708e9b9a-efe9-4758-b20d-51aceb214456 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:12.681774 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-708e9b9a-efe9-4758-b20d-51aceb214456 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:12.688732 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-708e9b9a-efe9-4758-b20d-51aceb214456 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:12.689179 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-708e9b9a-efe9-4758-b20d-51aceb214456 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:12.689963 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-708e9b9a-efe9-4758-b20d-51aceb214456 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:12.690390 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-708e9b9a-efe9-4758-b20d-51aceb214456 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:12.827180 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-708e9b9a-efe9-4758-b20d-51aceb214456 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:12.834547 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-708e9b9a-efe9-4758-b20d-51aceb214456 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1683 microversion: 2.1 time: 0.157222 Jul 21 23:42:12.835109 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 235/501] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:12 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:13.242522 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fffbd06f-5659-49af-8151-de0612231c1e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:13.243217 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fffbd06f-5659-49af-8151-de0612231c1e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:13.250413 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fffbd06f-5659-49af-8151-de0612231c1e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:13.250862 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fffbd06f-5659-49af-8151-de0612231c1e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:13.251966 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fffbd06f-5659-49af-8151-de0612231c1e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:13.252404 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fffbd06f-5659-49af-8151-de0612231c1e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:13.386365 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-fffbd06f-5659-49af-8151-de0612231c1e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:13.394254 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fffbd06f-5659-49af-8151-de0612231c1e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.155893 Jul 21 23:42:13.394817 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 267/502] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:13 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:13.850752 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-03307288-7523-4691-ae69-abbfb5d0860b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:13.851353 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-03307288-7523-4691-ae69-abbfb5d0860b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:13.858432 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-03307288-7523-4691-ae69-abbfb5d0860b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:13.858869 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-03307288-7523-4691-ae69-abbfb5d0860b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:13.859615 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-03307288-7523-4691-ae69-abbfb5d0860b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:13.860045 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-03307288-7523-4691-ae69-abbfb5d0860b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:13.998064 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-03307288-7523-4691-ae69-abbfb5d0860b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:14.005460 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-03307288-7523-4691-ae69-abbfb5d0860b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1683 microversion: 2.1 time: 0.158483 Jul 21 23:42:14.006013 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 236/503] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:13 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:14.412803 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-45debf3d-1434-4383-b3f5-b999f2ddd182 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:14.413382 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-45debf3d-1434-4383-b3f5-b999f2ddd182 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:14.420753 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-45debf3d-1434-4383-b3f5-b999f2ddd182 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:14.421328 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-45debf3d-1434-4383-b3f5-b999f2ddd182 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:14.422449 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-45debf3d-1434-4383-b3f5-b999f2ddd182 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:14.422880 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-45debf3d-1434-4383-b3f5-b999f2ddd182 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:14.553002 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-45debf3d-1434-4383-b3f5-b999f2ddd182 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:14.560879 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-45debf3d-1434-4383-b3f5-b999f2ddd182 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.152303 Jul 21 23:42:14.561474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 268/504] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:14 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:15.023219 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-448a553a-8c2e-4d3e-ae06-e6ff9fccb2ad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:15.023855 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-448a553a-8c2e-4d3e-ae06-e6ff9fccb2ad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:15.030558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-448a553a-8c2e-4d3e-ae06-e6ff9fccb2ad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:15.031206 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-448a553a-8c2e-4d3e-ae06-e6ff9fccb2ad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:15.031973 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-448a553a-8c2e-4d3e-ae06-e6ff9fccb2ad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:15.032448 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-448a553a-8c2e-4d3e-ae06-e6ff9fccb2ad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:15.252120 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-448a553a-8c2e-4d3e-ae06-e6ff9fccb2ad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:15.259568 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-448a553a-8c2e-4d3e-ae06-e6ff9fccb2ad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 200 len: 1683 microversion: 2.1 time: 0.240254 Jul 21 23:42:15.261103 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 237/505] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:15 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 1683 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:15.577990 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-88b7803c-0e48-4ca9-b8c3-07545efc44ac tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:15.578929 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-88b7803c-0e48-4ca9-b8c3-07545efc44ac tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:15.585548 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-88b7803c-0e48-4ca9-b8c3-07545efc44ac tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:15.586042 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-88b7803c-0e48-4ca9-b8c3-07545efc44ac tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:15.586758 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-88b7803c-0e48-4ca9-b8c3-07545efc44ac tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:15.587189 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-88b7803c-0e48-4ca9-b8c3-07545efc44ac tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:15.593623 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:15.650467 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-da47d212-8a94-4194-a299-62ac37d1bf39 req-6139e222-b46e-443e-a305-fcd98704be12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4395db50-179b-4591-bec9-a738ad477d31", "name": "network-vif-deleted", "tag": "b7d67a8b-6367-4be6-bd44-466169d1217b"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:15.661222 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-da47d212-8a94-4194-a299-62ac37d1bf39 req-6139e222-b46e-443e-a305-fcd98704be12 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:15.661661 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-da47d212-8a94-4194-a299-62ac37d1bf39 req-6139e222-b46e-443e-a305-fcd98704be12 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:15.676559 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-da47d212-8a94-4194-a299-62ac37d1bf39 req-6139e222-b46e-443e-a305-fcd98704be12 service nova] Creating event network-vif-deleted:b7d67a8b-6367-4be6-bd44-466169d1217b for instance 4395db50-179b-4591-bec9-a738ad477d31 on hv-cinder-85070 Jul 21 23:42:15.683711 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-da47d212-8a94-4194-a299-62ac37d1bf39 req-6139e222-b46e-443e-a305-fcd98704be12 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035455 Jul 21 23:42:15.689543 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 238/506] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:15.746156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-88b7803c-0e48-4ca9-b8c3-07545efc44ac tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:15.755981 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-88b7803c-0e48-4ca9-b8c3-07545efc44ac tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.181707 Jul 21 23:42:15.756563 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 269/507] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:15 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:16.278545 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c55bd6ac-e994-428f-b0a0-79316a4a17ab tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:16.279246 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-c55bd6ac-e994-428f-b0a0-79316a4a17ab tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:16.286069 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c55bd6ac-e994-428f-b0a0-79316a4a17ab tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:16.286528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c55bd6ac-e994-428f-b0a0-79316a4a17ab tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:16.287305 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c55bd6ac-e994-428f-b0a0-79316a4a17ab tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:16.287742 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c55bd6ac-e994-428f-b0a0-79316a4a17ab tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:16.302226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-c55bd6ac-e994-428f-b0a0-79316a4a17ab tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c55bd6ac-e994-428f-b0a0-79316a4a17ab tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 HTTP/1.1 Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:42:16.303946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:42:16.305512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': '4395db50-179b-4591-bec9-a738ad477d31'} Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:42:16.306511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:42:16.308695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:16.309756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c55bd6ac-e994-428f-b0a0-79316a4a17ab tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:42:16.309756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-c55bd6ac-e994-428f-b0a0-79316a4a17ab tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 404 len: 111 microversion: 2.1 time: 0.031348 Jul 21 23:42:16.309756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 239/508] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:16 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:42:16.315512 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3d4802c2-c673-4583-b0d8-d21f8677571c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '.version_select at 0x7f7d28c6cee0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:16.334159 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3d4802c2-c673-4583-b0d8-d21f8677571c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872246610" status: 202 len: 0 microversion: 2.1 time: 0.022377 Jul 21 23:42:16.334748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 270/509] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jul 21 23:42:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872246610 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:42:16.774025 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-29c60b85-761b-4e14-9e0d-e93b8c7189a1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:16.774629 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-29c60b85-761b-4e14-9e0d-e93b8c7189a1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:16.780581 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-29c60b85-761b-4e14-9e0d-e93b8c7189a1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:16.781025 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-29c60b85-761b-4e14-9e0d-e93b8c7189a1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:16.781857 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-29c60b85-761b-4e14-9e0d-e93b8c7189a1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:16.782290 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-29c60b85-761b-4e14-9e0d-e93b8c7189a1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:16.979819 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-29c60b85-761b-4e14-9e0d-e93b8c7189a1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:16.988008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-29c60b85-761b-4e14-9e0d-e93b8c7189a1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.217877 Jul 21 23:42:16.988577 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 240/510] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:16 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:17.065904 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4437232f-a345-4c5b-bdf3-880f4450735b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: .version_select at 0x7f7d28b82e50>, body: {"keypair": {"name": "tempest-keypair-1734751469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeYxhuvTVDu79f1Vs371UDp62tJOEh3aqDst7ezAzKjhpeXZMtEM3cYXTCH/1kk3nsOq28JQAY7qpfQrBjWK9EcjifxhQcGDdqVJHBPWuxFyf8GgzdlyBwHcODPbkef4A=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:17.080378 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-4437232f-a345-4c5b-bdf3-880f4450735b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for project fc4faed5bed7450da8122eeb77459f3a. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:42:17.084802 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-4437232f-a345-4c5b-bdf3-880f4450735b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for user c44b88237c0f4ae7a31fbaaddbb2d427 and project fc4faed5bed7450da8122eeb77459f3a. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:42:17.108754 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4437232f-a345-4c5b-bdf3-880f4450735b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047123 Jul 21 23:42:17.109387 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 271/511] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 23:42:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:18.005870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-02b22d9d-cdf0-44f4-aa42-24b715a37458 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:18.006605 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-02b22d9d-cdf0-44f4-aa42-24b715a37458 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:18.013870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-02b22d9d-cdf0-44f4-aa42-24b715a37458 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:18.014402 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-02b22d9d-cdf0-44f4-aa42-24b715a37458 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:18.015572 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-02b22d9d-cdf0-44f4-aa42-24b715a37458 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:18.016005 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-02b22d9d-cdf0-44f4-aa42-24b715a37458 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:18.167960 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-02b22d9d-cdf0-44f4-aa42-24b715a37458 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:18.175938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-02b22d9d-cdf0-44f4-aa42-24b715a37458 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.173959 Jul 21 23:42:18.176508 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 241/512] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:18 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:18.526244 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-873525660", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db7b04fe-74b8-4a1d-b84d-14b166fb83d5"}], "security_groups": [{"name": "tempest-securitygroup--929348061"}], "key_name": "tempest-keypair-1734751469", "user_data": "}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:18.627629 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] validate_networks() for [('db7b04fe-74b8-4a1d-b84d-14b166fb83d5', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:42:18.992821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:42:18.993549 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:42:18.994031 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:42:18.994448 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:42:18.994854 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:42:19.003752 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:19.004198 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:19.004995 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:19.005568 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:19.023145 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for project fc4faed5bed7450da8122eeb77459f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:42:19.027728 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for user c44b88237c0f4ae7a31fbaaddbb2d427 and project fc4faed5bed7450da8122eeb77459f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:42:19.038636 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:42:19.040886 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:42:19.087137 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bd3f32c6-8827-446d-a1ec-a118a58f5de2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.565681 Jul 21 23:42:19.087777 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 272/513] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:42:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:42:19.098421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-58930ac0-fdc3-407e-9d72-a70417fd283f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:19.099036 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-58930ac0-fdc3-407e-9d72-a70417fd283f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:19.155697 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-58930ac0-fdc3-407e-9d72-a70417fd283f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:19.162855 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-58930ac0-fdc3-407e-9d72-a70417fd283f tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1241 microversion: 2.1 time: 0.068181 Jul 21 23:42:19.163438 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 242/514] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:19 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:19.192953 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-be5821f7-6d88-4b8e-bc57-535154333dcd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:19.193706 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-be5821f7-6d88-4b8e-bc57-535154333dcd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:19.200933 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be5821f7-6d88-4b8e-bc57-535154333dcd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:19.201484 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be5821f7-6d88-4b8e-bc57-535154333dcd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:19.202319 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be5821f7-6d88-4b8e-bc57-535154333dcd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:19.202815 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be5821f7-6d88-4b8e-bc57-535154333dcd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:19.343876 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-be5821f7-6d88-4b8e-bc57-535154333dcd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:19.352417 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-be5821f7-6d88-4b8e-bc57-535154333dcd tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.163389 Jul 21 23:42:19.353018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 273/515] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:19 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:20.181070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7da01f70-0df7-49ca-9f67-8439bef2209e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:20.181953 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7da01f70-0df7-49ca-9f67-8439bef2209e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:20.192001 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7da01f70-0df7-49ca-9f67-8439bef2209e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:20.192553 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7da01f70-0df7-49ca-9f67-8439bef2209e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:20.193468 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7da01f70-0df7-49ca-9f67-8439bef2209e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:20.193980 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7da01f70-0df7-49ca-9f67-8439bef2209e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:20.271322 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7da01f70-0df7-49ca-9f67-8439bef2209e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:20.279864 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7da01f70-0df7-49ca-9f67-8439bef2209e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1311 microversion: 2.1 time: 0.103394 Jul 21 23:42:20.280422 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 243/516] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:20 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:20.370264 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d7b8e315-9fd9-465b-9b7b-e7d1f227423f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:20.370800 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d7b8e315-9fd9-465b-9b7b-e7d1f227423f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:20.377254 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d7b8e315-9fd9-465b-9b7b-e7d1f227423f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:20.377704 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d7b8e315-9fd9-465b-9b7b-e7d1f227423f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:20.378488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d7b8e315-9fd9-465b-9b7b-e7d1f227423f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:20.378936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d7b8e315-9fd9-465b-9b7b-e7d1f227423f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:20.515172 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d7b8e315-9fd9-465b-9b7b-e7d1f227423f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:20.523493 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d7b8e315-9fd9-465b-9b7b-e7d1f227423f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.157523 Jul 21 23:42:20.524080 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 274/517] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:20 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:21.297929 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-40b677e0-22f1-48e8-813e-153f7792ad16 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:21.298544 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-40b677e0-22f1-48e8-813e-153f7792ad16 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:21.305613 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-40b677e0-22f1-48e8-813e-153f7792ad16 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:21.306066 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-40b677e0-22f1-48e8-813e-153f7792ad16 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:21.307038 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-40b677e0-22f1-48e8-813e-153f7792ad16 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:21.308203 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-40b677e0-22f1-48e8-813e-153f7792ad16 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:21.519873 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-40b677e0-22f1-48e8-813e-153f7792ad16 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:21.527733 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-40b677e0-22f1-48e8-813e-153f7792ad16 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1366 microversion: 2.1 time: 0.233645 Jul 21 23:42:21.528299 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 244/518] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:21 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:21.541773 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c0cdc84b-269b-46a1-91bc-48a15809939d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:21.542970 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c0cdc84b-269b-46a1-91bc-48a15809939d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:21.550063 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0cdc84b-269b-46a1-91bc-48a15809939d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:21.550510 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0cdc84b-269b-46a1-91bc-48a15809939d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:21.551313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0cdc84b-269b-46a1-91bc-48a15809939d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:21.551750 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c0cdc84b-269b-46a1-91bc-48a15809939d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:21.695927 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c0cdc84b-269b-46a1-91bc-48a15809939d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:21.715513 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c0cdc84b-269b-46a1-91bc-48a15809939d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.177813 Jul 21 23:42:21.716599 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 275/519] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:21 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:21.887088 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-95b1a4a0-d46e-4688-9c16-125ecbc2b070 req-e30c7d81-7f32-45fc-ac5a-9c47e12c7177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d749247-571b-427e-83af-e7b9a7c3894d", "tag": "2620f97b-ffd2-4d54-91c5-27106fd73ada"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:21.899498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-95b1a4a0-d46e-4688-9c16-125ecbc2b070 req-e30c7d81-7f32-45fc-ac5a-9c47e12c7177 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:21.899905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-95b1a4a0-d46e-4688-9c16-125ecbc2b070 req-e30c7d81-7f32-45fc-ac5a-9c47e12c7177 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:21.914257 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-95b1a4a0-d46e-4688-9c16-125ecbc2b070 req-e30c7d81-7f32-45fc-ac5a-9c47e12c7177 service nova] Creating event network-changed:2620f97b-ffd2-4d54-91c5-27106fd73ada for instance 8d749247-571b-427e-83af-e7b9a7c3894d on hv-cinder-85070 Jul 21 23:42:21.919986 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-95b1a4a0-d46e-4688-9c16-125ecbc2b070 req-e30c7d81-7f32-45fc-ac5a-9c47e12c7177 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037542 Jul 21 23:42:21.920969 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 245/520] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:22.544566 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3a64f5fd-01d1-45c5-9b86-e546aa822cea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:22.545180 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3a64f5fd-01d1-45c5-9b86-e546aa822cea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:22.551643 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3a64f5fd-01d1-45c5-9b86-e546aa822cea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:22.552094 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3a64f5fd-01d1-45c5-9b86-e546aa822cea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:22.552851 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3a64f5fd-01d1-45c5-9b86-e546aa822cea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:22.553313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3a64f5fd-01d1-45c5-9b86-e546aa822cea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:22.681246 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3a64f5fd-01d1-45c5-9b86-e546aa822cea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:22.688556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3a64f5fd-01d1-45c5-9b86-e546aa822cea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1366 microversion: 2.1 time: 0.148552 Jul 21 23:42:22.689115 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 276/521] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:22 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:22.733802 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bd696a5c-89ee-4505-bcce-f40fe755da21 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:22.734528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bd696a5c-89ee-4505-bcce-f40fe755da21 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:22.740636 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd696a5c-89ee-4505-bcce-f40fe755da21 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:22.741081 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd696a5c-89ee-4505-bcce-f40fe755da21 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:22.741877 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd696a5c-89ee-4505-bcce-f40fe755da21 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:22.742308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd696a5c-89ee-4505-bcce-f40fe755da21 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:22.872816 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bd696a5c-89ee-4505-bcce-f40fe755da21 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:22.882308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bd696a5c-89ee-4505-bcce-f40fe755da21 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.153734 Jul 21 23:42:22.882989 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 246/522] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:22 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:23.705642 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d5f8b29b-c661-45e5-8d82-8166d9cb5c27 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:23.706244 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d5f8b29b-c661-45e5-8d82-8166d9cb5c27 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:23.712606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d5f8b29b-c661-45e5-8d82-8166d9cb5c27 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:23.713983 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d5f8b29b-c661-45e5-8d82-8166d9cb5c27 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:23.714901 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d5f8b29b-c661-45e5-8d82-8166d9cb5c27 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:23.715350 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d5f8b29b-c661-45e5-8d82-8166d9cb5c27 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:23.846500 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d5f8b29b-c661-45e5-8d82-8166d9cb5c27 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:23.853891 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d5f8b29b-c661-45e5-8d82-8166d9cb5c27 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1366 microversion: 2.1 time: 0.152102 Jul 21 23:42:23.854458 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 277/523] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:23 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:23.899822 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7f9b2667-5f9f-4557-86cb-3f0ffdb19e27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:23.900432 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7f9b2667-5f9f-4557-86cb-3f0ffdb19e27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:23.907154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f9b2667-5f9f-4557-86cb-3f0ffdb19e27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:23.907602 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f9b2667-5f9f-4557-86cb-3f0ffdb19e27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:23.908362 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f9b2667-5f9f-4557-86cb-3f0ffdb19e27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:23.908799 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f9b2667-5f9f-4557-86cb-3f0ffdb19e27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:24.038259 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7f9b2667-5f9f-4557-86cb-3f0ffdb19e27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:24.046376 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7f9b2667-5f9f-4557-86cb-3f0ffdb19e27 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.150428 Jul 21 23:42:24.046935 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 247/524] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:23 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:24.870907 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-31bd940b-c241-4c23-a08c-76a37c9f481e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:24.871513 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-31bd940b-c241-4c23-a08c-76a37c9f481e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:24.878321 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31bd940b-c241-4c23-a08c-76a37c9f481e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:24.878769 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31bd940b-c241-4c23-a08c-76a37c9f481e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:24.879539 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31bd940b-c241-4c23-a08c-76a37c9f481e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:24.879972 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-31bd940b-c241-4c23-a08c-76a37c9f481e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:25.013264 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-31bd940b-c241-4c23-a08c-76a37c9f481e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:25.020709 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-31bd940b-c241-4c23-a08c-76a37c9f481e tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1366 microversion: 2.1 time: 0.154064 Jul 21 23:42:25.021297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 278/525] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:24 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:25.063721 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bcb5e5cb-b750-4f4d-bdf0-3da722608368 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:25.064328 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bcb5e5cb-b750-4f4d-bdf0-3da722608368 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:25.070794 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bcb5e5cb-b750-4f4d-bdf0-3da722608368 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:25.071242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bcb5e5cb-b750-4f4d-bdf0-3da722608368 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:25.072003 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bcb5e5cb-b750-4f4d-bdf0-3da722608368 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:25.073056 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bcb5e5cb-b750-4f4d-bdf0-3da722608368 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:25.203379 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bcb5e5cb-b750-4f4d-bdf0-3da722608368 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:25.211198 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bcb5e5cb-b750-4f4d-bdf0-3da722608368 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.151268 Jul 21 23:42:25.211761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 248/526] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:25 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:25.713556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-81d76edf-767f-4b75-89b4-fbba4559e4c6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:25.714524 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-81d76edf-767f-4b75-89b4-fbba4559e4c6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:25.720518 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-81d76edf-767f-4b75-89b4-fbba4559e4c6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:25.720964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-81d76edf-767f-4b75-89b4-fbba4559e4c6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:25.721765 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-81d76edf-767f-4b75-89b4-fbba4559e4c6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:25.722194 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-81d76edf-767f-4b75-89b4-fbba4559e4c6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:25.793404 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-81d76edf-767f-4b75-89b4-fbba4559e4c6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "POST /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/action" status: 202 len: 0 microversion: 2.1 time: 0.083319 Jul 21 23:42:25.794022 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 279/527] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:42:25 2022] POST /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:42:25.801958 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0d15a327-c35f-48ac-976d-34c67893c85e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:25.802568 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0d15a327-c35f-48ac-976d-34c67893c85e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:25.809290 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0d15a327-c35f-48ac-976d-34c67893c85e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:25.809712 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0d15a327-c35f-48ac-976d-34c67893c85e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:25.810466 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0d15a327-c35f-48ac-976d-34c67893c85e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:25.810919 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0d15a327-c35f-48ac-976d-34c67893c85e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:26.038780 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-53a76270-eb1e-4472-8779-ec4f5c3be94c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:26.039598 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-53a76270-eb1e-4472-8779-ec4f5c3be94c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:26.045622 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0d15a327-c35f-48ac-976d-34c67893c85e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:26.046854 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53a76270-eb1e-4472-8779-ec4f5c3be94c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:26.047377 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53a76270-eb1e-4472-8779-ec4f5c3be94c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:26.048439 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53a76270-eb1e-4472-8779-ec4f5c3be94c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:26.048884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53a76270-eb1e-4472-8779-ec4f5c3be94c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:26.054108 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0d15a327-c35f-48ac-976d-34c67893c85e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1753 microversion: 2.1 time: 0.255736 Jul 21 23:42:26.054486 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 249/528] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:25 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1753 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:26.186099 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-53a76270-eb1e-4472-8779-ec4f5c3be94c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:26.193648 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-53a76270-eb1e-4472-8779-ec4f5c3be94c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1366 microversion: 2.1 time: 0.158968 Jul 21 23:42:26.194426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 280/529] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:26 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:26.230587 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9957de72-657c-4759-9e79-1d51a4ae0fd1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:26.231108 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9957de72-657c-4759-9e79-1d51a4ae0fd1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:26.237703 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9957de72-657c-4759-9e79-1d51a4ae0fd1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:26.238149 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9957de72-657c-4759-9e79-1d51a4ae0fd1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:26.238910 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9957de72-657c-4759-9e79-1d51a4ae0fd1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:26.239350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9957de72-657c-4759-9e79-1d51a4ae0fd1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:26.457924 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9957de72-657c-4759-9e79-1d51a4ae0fd1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:26.467215 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9957de72-657c-4759-9e79-1d51a4ae0fd1 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.241112 Jul 21 23:42:26.467837 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 250/530] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:26 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:27.071658 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a56c95a5-a8e7-4820-b110-3c716d347ca6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:27.072194 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a56c95a5-a8e7-4820-b110-3c716d347ca6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:27.079811 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a56c95a5-a8e7-4820-b110-3c716d347ca6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:27.080251 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a56c95a5-a8e7-4820-b110-3c716d347ca6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:27.081001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a56c95a5-a8e7-4820-b110-3c716d347ca6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:27.081455 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a56c95a5-a8e7-4820-b110-3c716d347ca6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:27.211223 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5e6b3b8b-a7db-4354-9f0d-4d74bf7d6307 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:27.211863 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5e6b3b8b-a7db-4354-9f0d-4d74bf7d6307 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:27.217942 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5e6b3b8b-a7db-4354-9f0d-4d74bf7d6307 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:27.218393 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5e6b3b8b-a7db-4354-9f0d-4d74bf7d6307 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:27.219187 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5e6b3b8b-a7db-4354-9f0d-4d74bf7d6307 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:27.219632 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5e6b3b8b-a7db-4354-9f0d-4d74bf7d6307 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:27.232071 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a56c95a5-a8e7-4820-b110-3c716d347ca6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:27.239966 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a56c95a5-a8e7-4820-b110-3c716d347ca6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.172253 Jul 21 23:42:27.240529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 281/531] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:27 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:27.356752 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5e6b3b8b-a7db-4354-9f0d-4d74bf7d6307 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:27.365013 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5e6b3b8b-a7db-4354-9f0d-4d74bf7d6307 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1366 microversion: 2.1 time: 0.157573 Jul 21 23:42:27.365706 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 251/532] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:27 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:27.480014 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-b545000e-41bc-4590-825b-cc69a751c689 req-8cb0be33-e626-41ee-aa87-8948016d83be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d749247-571b-427e-83af-e7b9a7c3894d", "name": "network-vif-plugged", "status": "completed", "tag": "2620f97b-ffd2-4d54-91c5-27106fd73ada"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:27.485088 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7b9910da-a57e-4a33-8d7a-12d8b1975df3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:27.485915 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7b9910da-a57e-4a33-8d7a-12d8b1975df3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:27.490508 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b545000e-41bc-4590-825b-cc69a751c689 req-8cb0be33-e626-41ee-aa87-8948016d83be service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:27.490859 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-b545000e-41bc-4590-825b-cc69a751c689 req-8cb0be33-e626-41ee-aa87-8948016d83be service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:27.496573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7b9910da-a57e-4a33-8d7a-12d8b1975df3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:27.497052 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7b9910da-a57e-4a33-8d7a-12d8b1975df3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:27.498087 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7b9910da-a57e-4a33-8d7a-12d8b1975df3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:27.498531 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7b9910da-a57e-4a33-8d7a-12d8b1975df3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:27.503709 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-b545000e-41bc-4590-825b-cc69a751c689 req-8cb0be33-e626-41ee-aa87-8948016d83be service nova] Creating event network-vif-plugged:2620f97b-ffd2-4d54-91c5-27106fd73ada for instance 8d749247-571b-427e-83af-e7b9a7c3894d on hv-cinder-85070 Jul 21 23:42:27.508611 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-b545000e-41bc-4590-825b-cc69a751c689 req-8cb0be33-e626-41ee-aa87-8948016d83be service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033072 Jul 21 23:42:27.509405 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 282/533] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:27.519509 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=100 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:27.648984 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7b9910da-a57e-4a33-8d7a-12d8b1975df3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:27.657546 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7b9910da-a57e-4a33-8d7a-12d8b1975df3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.176988 Jul 21 23:42:27.658103 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 252/534] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:27 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:28.259351 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7fd3455b-03bb-48de-9c27-2bd613ed43a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:28.260591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7fd3455b-03bb-48de-9c27-2bd613ed43a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:28.266801 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7fd3455b-03bb-48de-9c27-2bd613ed43a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:28.267255 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7fd3455b-03bb-48de-9c27-2bd613ed43a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:28.268020 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7fd3455b-03bb-48de-9c27-2bd613ed43a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:28.268452 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7fd3455b-03bb-48de-9c27-2bd613ed43a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:28.383621 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e263fa83-583b-415f-92c4-dd72f1941552 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:28.384164 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e263fa83-583b-415f-92c4-dd72f1941552 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:28.391211 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e263fa83-583b-415f-92c4-dd72f1941552 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:28.391659 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e263fa83-583b-415f-92c4-dd72f1941552 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:28.392421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e263fa83-583b-415f-92c4-dd72f1941552 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:28.392854 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e263fa83-583b-415f-92c4-dd72f1941552 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:28.413584 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7fd3455b-03bb-48de-9c27-2bd613ed43a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:28.421545 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7fd3455b-03bb-48de-9c27-2bd613ed43a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.166814 Jul 21 23:42:28.422115 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 283/535] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:28 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:28.522680 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e263fa83-583b-415f-92c4-dd72f1941552 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:28.531075 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e263fa83-583b-415f-92c4-dd72f1941552 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1366 microversion: 2.1 time: 0.151486 Jul 21 23:42:28.531673 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 253/536] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:28 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:28.675042 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1892c384-9409-4440-952d-448cced336f0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:28.675593 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1892c384-9409-4440-952d-448cced336f0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:28.677552 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:28.683610 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1892c384-9409-4440-952d-448cced336f0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:28.684057 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1892c384-9409-4440-952d-448cced336f0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:28.684818 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1892c384-9409-4440-952d-448cced336f0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:28.685289 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1892c384-9409-4440-952d-448cced336f0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:28.816072 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1892c384-9409-4440-952d-448cced336f0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:28.824196 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1892c384-9409-4440-952d-448cced336f0 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.153077 Jul 21 23:42:28.824768 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 284/537] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:28 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:29.439979 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bdf9e942-e7de-4c8c-9adb-202af68d50fd tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:29.440580 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bdf9e942-e7de-4c8c-9adb-202af68d50fd tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:29.442431 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:29.448678 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bdf9e942-e7de-4c8c-9adb-202af68d50fd tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:29.449115 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bdf9e942-e7de-4c8c-9adb-202af68d50fd tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:29.449895 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bdf9e942-e7de-4c8c-9adb-202af68d50fd tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:29.450321 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bdf9e942-e7de-4c8c-9adb-202af68d50fd tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:29.548408 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6d8be326-ab98-4d5c-a2e7-155b9d519a73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:29.549152 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6d8be326-ab98-4d5c-a2e7-155b9d519a73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:29.552301 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:29.553027 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=10 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:29.558081 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d8be326-ab98-4d5c-a2e7-155b9d519a73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:29.558516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d8be326-ab98-4d5c-a2e7-155b9d519a73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:29.559293 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d8be326-ab98-4d5c-a2e7-155b9d519a73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:29.559732 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d8be326-ab98-4d5c-a2e7-155b9d519a73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:29.597647 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bdf9e942-e7de-4c8c-9adb-202af68d50fd tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:29.605814 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bdf9e942-e7de-4c8c-9adb-202af68d50fd tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.169833 Jul 21 23:42:29.606391 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 254/538] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:29 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:29.694965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6d8be326-ab98-4d5c-a2e7-155b9d519a73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:29.702924 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6d8be326-ab98-4d5c-a2e7-155b9d519a73 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1557 microversion: 2.1 time: 0.158427 Jul 21 23:42:29.703487 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 285/539] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:29 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:29.719610 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2f590506-fbdd-4c5d-b820-dee314ce904c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:29.720104 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2f590506-fbdd-4c5d-b820-dee314ce904c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:29.726031 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2f590506-fbdd-4c5d-b820-dee314ce904c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:29.726473 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2f590506-fbdd-4c5d-b820-dee314ce904c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:29.727227 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2f590506-fbdd-4c5d-b820-dee314ce904c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:29.727659 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2f590506-fbdd-4c5d-b820-dee314ce904c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:29.804744 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2f590506-fbdd-4c5d-b820-dee314ce904c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088914 Jul 21 23:42:29.805723 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 255/540] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 23:42:29 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:29.841459 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5fb2d4e8-1738-4fc6-9dc7-2f6f52881bc8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:29.842224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5fb2d4e8-1738-4fc6-9dc7-2f6f52881bc8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:29.848411 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5fb2d4e8-1738-4fc6-9dc7-2f6f52881bc8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:29.848939 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5fb2d4e8-1738-4fc6-9dc7-2f6f52881bc8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:29.849805 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5fb2d4e8-1738-4fc6-9dc7-2f6f52881bc8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:29.850314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5fb2d4e8-1738-4fc6-9dc7-2f6f52881bc8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:29.983609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5fb2d4e8-1738-4fc6-9dc7-2f6f52881bc8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:29.991640 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5fb2d4e8-1738-4fc6-9dc7-2f6f52881bc8 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.154225 Jul 21 23:42:29.992205 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 286/541] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:29 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:30.624165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7f5fca8f-bc63-4c47-9b4b-305605a77359 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:30.624753 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7f5fca8f-bc63-4c47-9b4b-305605a77359 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:30.630934 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f5fca8f-bc63-4c47-9b4b-305605a77359 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:30.631377 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f5fca8f-bc63-4c47-9b4b-305605a77359 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:30.632143 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f5fca8f-bc63-4c47-9b4b-305605a77359 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:30.632573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7f5fca8f-bc63-4c47-9b4b-305605a77359 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:31.009308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-49aa8b26-3a8f-40b5-a456-a2e09ec00810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:31.010578 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-49aa8b26-3a8f-40b5-a456-a2e09ec00810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:31.017615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-49aa8b26-3a8f-40b5-a456-a2e09ec00810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:31.018066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-49aa8b26-3a8f-40b5-a456-a2e09ec00810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:31.018844 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-49aa8b26-3a8f-40b5-a456-a2e09ec00810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:31.019278 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-49aa8b26-3a8f-40b5-a456-a2e09ec00810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:31.069136 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7f5fca8f-bc63-4c47-9b4b-305605a77359 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:31.077826 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7f5fca8f-bc63-4c47-9b4b-305605a77359 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.458507 Jul 21 23:42:31.078572 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 256/542] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:30 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:31.083510 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-e8534327-9557-416f-b54f-0452814531f7 req-b587ba04-899e-4925-85c3-7ef24c167f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d749247-571b-427e-83af-e7b9a7c3894d", "tag": "2620f97b-ffd2-4d54-91c5-27106fd73ada"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:31.093885 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-e8534327-9557-416f-b54f-0452814531f7 req-b587ba04-899e-4925-85c3-7ef24c167f29 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:31.094787 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-e8534327-9557-416f-b54f-0452814531f7 req-b587ba04-899e-4925-85c3-7ef24c167f29 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:31.106912 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-e8534327-9557-416f-b54f-0452814531f7 req-b587ba04-899e-4925-85c3-7ef24c167f29 service nova] Creating event network-changed:2620f97b-ffd2-4d54-91c5-27106fd73ada for instance 8d749247-571b-427e-83af-e7b9a7c3894d on hv-cinder-85070 Jul 21 23:42:31.113596 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-e8534327-9557-416f-b54f-0452814531f7 req-b587ba04-899e-4925-85c3-7ef24c167f29 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032701 Jul 21 23:42:31.114757 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 257/543] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:31.179100 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-49aa8b26-3a8f-40b5-a456-a2e09ec00810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:31.188005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-49aa8b26-3a8f-40b5-a456-a2e09ec00810 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.182444 Jul 21 23:42:31.193246 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 287/544] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:31 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:32.095868 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c70e11e1-d80a-4b7f-af0b-ee002e160aab tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:32.096614 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-c70e11e1-d80a-4b7f-af0b-ee002e160aab tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:32.103452 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c70e11e1-d80a-4b7f-af0b-ee002e160aab tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:32.104662 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c70e11e1-d80a-4b7f-af0b-ee002e160aab tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:32.105647 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c70e11e1-d80a-4b7f-af0b-ee002e160aab tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:32.106075 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c70e11e1-d80a-4b7f-af0b-ee002e160aab tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:32.205978 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e96634d8-6111-4bf8-9ab4-fa05cbf7c7a6 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:32.207141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e96634d8-6111-4bf8-9ab4-fa05cbf7c7a6 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:32.215234 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e96634d8-6111-4bf8-9ab4-fa05cbf7c7a6 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:32.215688 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e96634d8-6111-4bf8-9ab4-fa05cbf7c7a6 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:32.216467 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e96634d8-6111-4bf8-9ab4-fa05cbf7c7a6 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:32.216904 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e96634d8-6111-4bf8-9ab4-fa05cbf7c7a6 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:32.221147 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:32.272479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c70e11e1-d80a-4b7f-af0b-ee002e160aab tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:32.282049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-c70e11e1-d80a-4b7f-af0b-ee002e160aab tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.190353 Jul 21 23:42:32.282623 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 258/545] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:32 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:32.356694 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e96634d8-6111-4bf8-9ab4-fa05cbf7c7a6 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:32.364791 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e96634d8-6111-4bf8-9ab4-fa05cbf7c7a6 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.162726 Jul 21 23:42:32.365392 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 288/546] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:32 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:33.299883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6b04b82f-c8f7-4a47-b4a7-304124f9edae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:33.300484 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6b04b82f-c8f7-4a47-b4a7-304124f9edae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:33.307079 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6b04b82f-c8f7-4a47-b4a7-304124f9edae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:33.307533 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6b04b82f-c8f7-4a47-b4a7-304124f9edae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:33.308284 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6b04b82f-c8f7-4a47-b4a7-304124f9edae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:33.308714 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6b04b82f-c8f7-4a47-b4a7-304124f9edae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:33.383427 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2fff17d3-7b8f-482c-96d1-b3971e60cb77 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:33.383948 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2fff17d3-7b8f-482c-96d1-b3971e60cb77 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:33.391017 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2fff17d3-7b8f-482c-96d1-b3971e60cb77 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:33.391464 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2fff17d3-7b8f-482c-96d1-b3971e60cb77 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:33.392224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2fff17d3-7b8f-482c-96d1-b3971e60cb77 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:33.392659 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2fff17d3-7b8f-482c-96d1-b3971e60cb77 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:33.459459 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6b04b82f-c8f7-4a47-b4a7-304124f9edae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:33.467987 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6b04b82f-c8f7-4a47-b4a7-304124f9edae tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.171864 Jul 21 23:42:33.468555 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 259/547] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:33 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:33.529852 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2fff17d3-7b8f-482c-96d1-b3971e60cb77 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:33.537890 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2fff17d3-7b8f-482c-96d1-b3971e60cb77 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.158417 Jul 21 23:42:33.538458 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 289/548] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:33 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:34.485654 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b1b46999-2836-49b9-afba-137c9bbc442f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:34.486256 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b1b46999-2836-49b9-afba-137c9bbc442f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:34.488678 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=88 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:34.496190 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b1b46999-2836-49b9-afba-137c9bbc442f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:34.496644 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b1b46999-2836-49b9-afba-137c9bbc442f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:34.497460 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b1b46999-2836-49b9-afba-137c9bbc442f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:34.497902 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b1b46999-2836-49b9-afba-137c9bbc442f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:34.557899 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-69e8ca3d-3990-4629-87e6-e408d4e61161 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:34.558513 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-69e8ca3d-3990-4629-87e6-e408d4e61161 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:34.565387 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69e8ca3d-3990-4629-87e6-e408d4e61161 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:34.565834 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69e8ca3d-3990-4629-87e6-e408d4e61161 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:34.566599 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69e8ca3d-3990-4629-87e6-e408d4e61161 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:34.567032 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-69e8ca3d-3990-4629-87e6-e408d4e61161 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:34.647610 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b1b46999-2836-49b9-afba-137c9bbc442f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:34.656302 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b1b46999-2836-49b9-afba-137c9bbc442f tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.174535 Jul 21 23:42:34.657235 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 260/549] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:34 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:34.708800 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-69e8ca3d-3990-4629-87e6-e408d4e61161 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:34.717253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-69e8ca3d-3990-4629-87e6-e408d4e61161 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1734 microversion: 2.1 time: 0.165750 Jul 21 23:42:34.717822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 290/550] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:34 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:35.673158 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e8d94073-07e0-4e97-9675-1ef830424eb0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:35.673773 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e8d94073-07e0-4e97-9675-1ef830424eb0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:35.680200 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e8d94073-07e0-4e97-9675-1ef830424eb0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:35.680650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e8d94073-07e0-4e97-9675-1ef830424eb0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:35.681442 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e8d94073-07e0-4e97-9675-1ef830424eb0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:35.681917 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e8d94073-07e0-4e97-9675-1ef830424eb0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:35.734469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-48f70614-876b-44e0-9e54-5e6c778a7480 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:35.735121 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-48f70614-876b-44e0-9e54-5e6c778a7480 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:35.741688 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-48f70614-876b-44e0-9e54-5e6c778a7480 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:35.742144 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-48f70614-876b-44e0-9e54-5e6c778a7480 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:35.743173 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-48f70614-876b-44e0-9e54-5e6c778a7480 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:35.743615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-48f70614-876b-44e0-9e54-5e6c778a7480 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:35.838241 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e8d94073-07e0-4e97-9675-1ef830424eb0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:35.845981 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e8d94073-07e0-4e97-9675-1ef830424eb0 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.176702 Jul 21 23:42:35.846554 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 261/551] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:35 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:35.875088 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-48f70614-876b-44e0-9e54-5e6c778a7480 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:35.883560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-48f70614-876b-44e0-9e54-5e6c778a7480 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1714 microversion: 2.1 time: 0.152953 Jul 21 23:42:35.884134 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 291/552] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:35 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:35.987761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4fb61d89-7860-4b42-8e06-21c179caecde tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:35.988255 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4fb61d89-7860-4b42-8e06-21c179caecde tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:35.995056 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4fb61d89-7860-4b42-8e06-21c179caecde tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:35.995499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4fb61d89-7860-4b42-8e06-21c179caecde tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:35.996251 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4fb61d89-7860-4b42-8e06-21c179caecde tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:35.996680 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4fb61d89-7860-4b42-8e06-21c179caecde tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:36.122368 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-4fb61d89-7860-4b42-8e06-21c179caecde tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] HTTP exception thrown: Cannot 'detach_volume' instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 while it is in vm_state rescued Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4fb61d89-7860-4b42-8e06-21c179caecde tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Request method failure captured: Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: DELETE /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments/bc7f06e4-37b6-4899-9ab2-5eb594f4b0c9 HTTP/1.1 Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOCyt5wNh_FEH36U-N0FQ8k_LyJAXtHZSu59k19ZVRspQaZUsZ2DfEOu4e8nxmFuU1dRPWLDo-7fs91ec5VLI_Y6xDsEXbioO6oijaevSZ7cyjgE4y4BNi72hFr6v9vZ7YV5VEpYuDxKOyg1RiPmTl3T5dBjovp0fu-vBs8xSx_6Gw Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 79b6d71ecbf94b7a81761727712881ea Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:42:36.124004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:42:36.125612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79b6d71ecbf94b7a81761727712881ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/79b6d71ecbf94b7a81761727712881ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_79b6d71ecbf94b7a81761727712881ea", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79b6d71ecbf94b7a81761727712881ea"}]}] Jul 21 23:42:36.125612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:42:36.125612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 79b6d71ecbf94b7a81761727712881ea Jul 21 23:42:36.125612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:42:36.125612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-ServerRescueNegativeTestJSON-777922945-project Jul 21 23:42:36.125612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:42:36.125612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:42:36.125612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: b991805cfa834aab8dcab7d94d108ee2 Jul 21 23:42:36.125612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777922945-project Jul 21 23:42:36.125612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:42:36.125612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Cannot 'detach_volume' instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 while it is in vm_state rescued Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'server_id': 'c9b1ede1-a46a-454d-9b81-5b06de1124e9', 'id': 'bc7f06e4-37b6-4899-9ab2-5eb594f4b0c9'} Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:42:36.126525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 while it is in vm_state rescued Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 while it is in vm_state rescued Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:42:36.128070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4fb61d89-7860-4b42-8e06-21c179caecde tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Returning 409 to user: Cannot 'detach_volume' instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 while it is in vm_state rescued {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:42:36.129827 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4fb61d89-7860-4b42-8e06-21c179caecde tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments/bc7f06e4-37b6-4899-9ab2-5eb594f4b0c9" status: 409 len: 152 microversion: 2.1 time: 0.141713 Jul 21 23:42:36.129827 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 262/553] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:42:35 2022] DELETE /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments/bc7f06e4-37b6-4899-9ab2-5eb594f4b0c9 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 23:42:36.134312 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6ab6a956-22d5-49d4-b740-b1cc710eae31 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:36.135495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6ab6a956-22d5-49d4-b740-b1cc710eae31 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:36.141471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6ab6a956-22d5-49d4-b740-b1cc710eae31 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:36.141916 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6ab6a956-22d5-49d4-b740-b1cc710eae31 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:36.142673 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6ab6a956-22d5-49d4-b740-b1cc710eae31 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:36.143129 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6ab6a956-22d5-49d4-b740-b1cc710eae31 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:36.206231 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6ab6a956-22d5-49d4-b740-b1cc710eae31 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "POST /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/action" status: 202 len: 0 microversion: 2.1 time: 0.075597 Jul 21 23:42:36.209173 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 292/554] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:42:36 2022] POST /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:42:36.215251 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f0e7d1fa-fda3-4b07-b800-a7113590fdf3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:36.216534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f0e7d1fa-fda3-4b07-b800-a7113590fdf3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:36.222967 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f0e7d1fa-fda3-4b07-b800-a7113590fdf3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:36.223503 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f0e7d1fa-fda3-4b07-b800-a7113590fdf3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:36.224190 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f0e7d1fa-fda3-4b07-b800-a7113590fdf3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:36.224659 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f0e7d1fa-fda3-4b07-b800-a7113590fdf3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:36.437450 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f0e7d1fa-fda3-4b07-b800-a7113590fdf3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:36.445495 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f0e7d1fa-fda3-4b07-b800-a7113590fdf3 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1722 microversion: 2.1 time: 0.234316 Jul 21 23:42:36.446100 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 263/555] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:36 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:36.864723 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-47b81f90-f5a2-4167-a880-47ea4ed7f6ef tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:36.865355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-47b81f90-f5a2-4167-a880-47ea4ed7f6ef tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:36.872561 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47b81f90-f5a2-4167-a880-47ea4ed7f6ef tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:36.873003 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47b81f90-f5a2-4167-a880-47ea4ed7f6ef tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:36.873816 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47b81f90-f5a2-4167-a880-47ea4ed7f6ef tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:36.874249 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-47b81f90-f5a2-4167-a880-47ea4ed7f6ef tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:37.023562 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-47b81f90-f5a2-4167-a880-47ea4ed7f6ef tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:37.032487 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-47b81f90-f5a2-4167-a880-47ea4ed7f6ef tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.172573 Jul 21 23:42:37.033045 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 293/556] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:36 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:37.462836 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-133fcb30-d92f-4105-beb5-9c86c508051d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:37.463365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-133fcb30-d92f-4105-beb5-9c86c508051d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:37.470262 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-133fcb30-d92f-4105-beb5-9c86c508051d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:37.470704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-133fcb30-d92f-4105-beb5-9c86c508051d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:37.471454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-133fcb30-d92f-4105-beb5-9c86c508051d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:37.471892 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-133fcb30-d92f-4105-beb5-9c86c508051d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:37.600429 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-133fcb30-d92f-4105-beb5-9c86c508051d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:37.608361 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-133fcb30-d92f-4105-beb5-9c86c508051d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1722 microversion: 2.1 time: 0.149492 Jul 21 23:42:37.608953 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 264/557] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:37 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:38.049808 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ceec5749-235e-4489-8850-015461184536 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:38.050350 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ceec5749-235e-4489-8850-015461184536 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:38.057886 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ceec5749-235e-4489-8850-015461184536 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:38.058335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ceec5749-235e-4489-8850-015461184536 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:38.059092 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ceec5749-235e-4489-8850-015461184536 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:38.059523 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ceec5749-235e-4489-8850-015461184536 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:38.203383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ceec5749-235e-4489-8850-015461184536 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:38.211207 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ceec5749-235e-4489-8850-015461184536 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.165333 Jul 21 23:42:38.211767 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 294/558] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:38 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:38.626401 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-062984a7-18a3-4502-9e30-11ee9d9184fb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:38.627006 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-062984a7-18a3-4502-9e30-11ee9d9184fb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:38.633756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-062984a7-18a3-4502-9e30-11ee9d9184fb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:38.634211 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-062984a7-18a3-4502-9e30-11ee9d9184fb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:38.635199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-062984a7-18a3-4502-9e30-11ee9d9184fb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:38.635641 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-062984a7-18a3-4502-9e30-11ee9d9184fb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:38.768233 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-062984a7-18a3-4502-9e30-11ee9d9184fb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:38.776194 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-062984a7-18a3-4502-9e30-11ee9d9184fb tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1722 microversion: 2.1 time: 0.153791 Jul 21 23:42:38.776753 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 265/559] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:38 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:39.230609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f8d03d9a-c17c-482c-bffb-c4b11ffaeb60 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:39.231413 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f8d03d9a-c17c-482c-bffb-c4b11ffaeb60 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:39.238134 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8d03d9a-c17c-482c-bffb-c4b11ffaeb60 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:39.238584 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8d03d9a-c17c-482c-bffb-c4b11ffaeb60 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:39.239723 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8d03d9a-c17c-482c-bffb-c4b11ffaeb60 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:39.239852 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8d03d9a-c17c-482c-bffb-c4b11ffaeb60 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:39.397549 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f8d03d9a-c17c-482c-bffb-c4b11ffaeb60 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:39.405754 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f8d03d9a-c17c-482c-bffb-c4b11ffaeb60 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.181414 Jul 21 23:42:39.406330 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 295/560] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:39 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:39.792864 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4f77fadd-2c6a-4ae4-96c2-64b7df300c15 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:39.793489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4f77fadd-2c6a-4ae4-96c2-64b7df300c15 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:39.799642 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4f77fadd-2c6a-4ae4-96c2-64b7df300c15 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:39.800089 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4f77fadd-2c6a-4ae4-96c2-64b7df300c15 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:39.800846 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4f77fadd-2c6a-4ae4-96c2-64b7df300c15 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:39.801314 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4f77fadd-2c6a-4ae4-96c2-64b7df300c15 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:39.931756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4f77fadd-2c6a-4ae4-96c2-64b7df300c15 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:39.939859 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4f77fadd-2c6a-4ae4-96c2-64b7df300c15 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1728 microversion: 2.1 time: 0.151167 Jul 21 23:42:39.940424 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 266/561] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:39 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:39.956881 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-373ebbfb-f2bf-45f9-8cdf-31445fdda7c4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:39.957411 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-373ebbfb-f2bf-45f9-8cdf-31445fdda7c4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:39.964296 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-373ebbfb-f2bf-45f9-8cdf-31445fdda7c4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:39.964742 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-373ebbfb-f2bf-45f9-8cdf-31445fdda7c4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:39.965532 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-373ebbfb-f2bf-45f9-8cdf-31445fdda7c4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:39.965964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-373ebbfb-f2bf-45f9-8cdf-31445fdda7c4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:40.045381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-373ebbfb-f2bf-45f9-8cdf-31445fdda7c4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092286 Jul 21 23:42:40.045979 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 296/562] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 23:42:39 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:40.422868 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-cd4d5b33-9f87-40ce-a648-4a50417ca738 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:40.423507 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-cd4d5b33-9f87-40ce-a648-4a50417ca738 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:40.429620 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd4d5b33-9f87-40ce-a648-4a50417ca738 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:40.430067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd4d5b33-9f87-40ce-a648-4a50417ca738 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:40.430834 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd4d5b33-9f87-40ce-a648-4a50417ca738 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:40.431266 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd4d5b33-9f87-40ce-a648-4a50417ca738 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:40.663517 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cd4d5b33-9f87-40ce-a648-4a50417ca738 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:40.671959 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-cd4d5b33-9f87-40ce-a648-4a50417ca738 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.253070 Jul 21 23:42:40.672532 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 267/563] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:40 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:41.014384 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-774a52e9-ab6f-457e-b5e4-5b5777693a11 req-76ad96ac-15e2-430b-bd0c-53f4641d8704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b1ede1-a46a-454d-9b81-5b06de1124e9", "tag": "35c14d66-0050-4ea8-b943-7e894d33c3e5"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:41.023220 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-774a52e9-ab6f-457e-b5e4-5b5777693a11 req-76ad96ac-15e2-430b-bd0c-53f4641d8704 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:41.023789 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-774a52e9-ab6f-457e-b5e4-5b5777693a11 req-76ad96ac-15e2-430b-bd0c-53f4641d8704 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:41.040155 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-774a52e9-ab6f-457e-b5e4-5b5777693a11 req-76ad96ac-15e2-430b-bd0c-53f4641d8704 service nova] Creating event network-changed:35c14d66-0050-4ea8-b943-7e894d33c3e5 for instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 on hv-cinder-85070 Jul 21 23:42:41.043807 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-774a52e9-ab6f-457e-b5e4-5b5777693a11 req-76ad96ac-15e2-430b-bd0c-53f4641d8704 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034089 Jul 21 23:42:41.044364 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 297/564] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:41.689587 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5a32aa94-c1d8-4a85-9a48-5c5627a9da3e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:41.690291 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5a32aa94-c1d8-4a85-9a48-5c5627a9da3e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:41.696513 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a32aa94-c1d8-4a85-9a48-5c5627a9da3e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:41.696979 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a32aa94-c1d8-4a85-9a48-5c5627a9da3e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:41.698455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a32aa94-c1d8-4a85-9a48-5c5627a9da3e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:41.698891 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a32aa94-c1d8-4a85-9a48-5c5627a9da3e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:41.850092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5a32aa94-c1d8-4a85-9a48-5c5627a9da3e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:41.858749 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5a32aa94-c1d8-4a85-9a48-5c5627a9da3e tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.172886 Jul 21 23:42:41.859321 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 268/565] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:41 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:42.877058 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5d6271d3-1202-44e0-80fa-ebdc484435c5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:42.877711 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5d6271d3-1202-44e0-80fa-ebdc484435c5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:42.884337 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d6271d3-1202-44e0-80fa-ebdc484435c5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:42.885967 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d6271d3-1202-44e0-80fa-ebdc484435c5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:42.886730 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d6271d3-1202-44e0-80fa-ebdc484435c5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:42.887159 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d6271d3-1202-44e0-80fa-ebdc484435c5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:43.029345 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5d6271d3-1202-44e0-80fa-ebdc484435c5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:43.037383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5d6271d3-1202-44e0-80fa-ebdc484435c5 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.165009 Jul 21 23:42:43.037941 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 298/566] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:42 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:43.058603 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-3c44dedb-faf5-4ff3-8c4b-539520365ba0 req-bfdc6a31-fcaf-4eb0-80c6-fa7a1ebd46e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b1ede1-a46a-454d-9b81-5b06de1124e9", "tag": "35c14d66-0050-4ea8-b943-7e894d33c3e5"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:43.067063 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-3c44dedb-faf5-4ff3-8c4b-539520365ba0 req-bfdc6a31-fcaf-4eb0-80c6-fa7a1ebd46e3 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:43.067504 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-3c44dedb-faf5-4ff3-8c4b-539520365ba0 req-bfdc6a31-fcaf-4eb0-80c6-fa7a1ebd46e3 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:43.078781 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-3c44dedb-faf5-4ff3-8c4b-539520365ba0 req-bfdc6a31-fcaf-4eb0-80c6-fa7a1ebd46e3 service nova] Creating event network-changed:35c14d66-0050-4ea8-b943-7e894d33c3e5 for instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 on hv-cinder-85070 Jul 21 23:42:43.083660 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-3c44dedb-faf5-4ff3-8c4b-539520365ba0 req-bfdc6a31-fcaf-4eb0-80c6-fa7a1ebd46e3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029307 Jul 21 23:42:43.084230 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 269/567] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:42:44.054959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cc0b5be9-f2cb-445b-b85b-16d97d03768c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:44.055499 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cc0b5be9-f2cb-445b-b85b-16d97d03768c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:44.062643 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc0b5be9-f2cb-445b-b85b-16d97d03768c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:44.063084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc0b5be9-f2cb-445b-b85b-16d97d03768c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:44.063836 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc0b5be9-f2cb-445b-b85b-16d97d03768c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:44.064267 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cc0b5be9-f2cb-445b-b85b-16d97d03768c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:44.210147 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cc0b5be9-f2cb-445b-b85b-16d97d03768c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:44.218354 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cc0b5be9-f2cb-445b-b85b-16d97d03768c tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1758 microversion: 2.1 time: 0.167316 Jul 21 23:42:44.218937 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 299/568] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:44 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:45.236269 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-97780e48-62fd-4576-976f-90df8e2dfb41 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:45.236953 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-97780e48-62fd-4576-976f-90df8e2dfb41 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:45.243452 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-97780e48-62fd-4576-976f-90df8e2dfb41 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:45.243892 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-97780e48-62fd-4576-976f-90df8e2dfb41 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:45.244795 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-97780e48-62fd-4576-976f-90df8e2dfb41 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:45.245247 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-97780e48-62fd-4576-976f-90df8e2dfb41 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:45.388971 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-97780e48-62fd-4576-976f-90df8e2dfb41 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:45.392457 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=100 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:45.397423 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-97780e48-62fd-4576-976f-90df8e2dfb41 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1761 microversion: 2.1 time: 0.165870 Jul 21 23:42:45.397988 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 270/569] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:45 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1761 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:54.423989 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bcd6865e-2028-46e5-8fd5-d3bd10a5a195 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:54.424514 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bcd6865e-2028-46e5-8fd5-d3bd10a5a195 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:54.427072 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=31 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:54.427901 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:54.433699 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcd6865e-2028-46e5-8fd5-d3bd10a5a195 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:54.434154 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcd6865e-2028-46e5-8fd5-d3bd10a5a195 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:54.434930 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcd6865e-2028-46e5-8fd5-d3bd10a5a195 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:54.435369 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bcd6865e-2028-46e5-8fd5-d3bd10a5a195 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:54.515634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-bcd6865e-2028-46e5-8fd5-d3bd10a5a195 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lazy-loading 'services' on Instance uuid 946cd660-c484-440f-873a-84c4c0a208fd {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:42:54.589900 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bcd6865e-2028-46e5-8fd5-d3bd10a5a195 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "DELETE /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/os-volume_attachments/0027b7bd-b25d-44c2-b48e-f0122ffbcf5d" status: 202 len: 0 microversion: 2.1 time: 0.169667 Jul 21 23:42:54.590469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 300/570] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:42:54 2022] DELETE /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/os-volume_attachments/0027b7bd-b25d-44c2-b48e-f0122ffbcf5d => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:42:55.218673 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1730d067-f779-4907-81df-c9934a97ec26 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:55.219298 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1730d067-f779-4907-81df-c9934a97ec26 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:55.226366 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1730d067-f779-4907-81df-c9934a97ec26 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:55.226813 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1730d067-f779-4907-81df-c9934a97ec26 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:55.227573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1730d067-f779-4907-81df-c9934a97ec26 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:55.228620 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1730d067-f779-4907-81df-c9934a97ec26 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:55.263410 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1730d067-f779-4907-81df-c9934a97ec26 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments/f06a04eb-6c34-425d-a409-d5b0b0ba71d9" status: 200 len: 194 microversion: 2.20 time: 0.049218 Jul 21 23:42:55.264204 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 271/571] 10.222.0.57 () {60 vars in 1453 bytes} [Thu Jul 21 23:42:55 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments/f06a04eb-6c34-425d-a409-d5b0b0ba71d9 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:42:55.327674 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-41b687f7-4dd7-4fa5-99ac-e3e26cb09f79 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:55.328260 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-41b687f7-4dd7-4fa5-99ac-e3e26cb09f79 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:55.334496 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b687f7-4dd7-4fa5-99ac-e3e26cb09f79 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:55.334946 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b687f7-4dd7-4fa5-99ac-e3e26cb09f79 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:55.335716 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b687f7-4dd7-4fa5-99ac-e3e26cb09f79 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:55.336151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b687f7-4dd7-4fa5-99ac-e3e26cb09f79 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:55.417196 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-41b687f7-4dd7-4fa5-99ac-e3e26cb09f79 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lazy-loading 'services' on Instance uuid eb1e0d18-427a-456e-8ca0-c246e41f1fab {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:42:55.486909 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-41b687f7-4dd7-4fa5-99ac-e3e26cb09f79 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "DELETE /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments/f06a04eb-6c34-425d-a409-d5b0b0ba71d9" status: 202 len: 0 microversion: 2.20 time: 0.163345 Jul 21 23:42:55.487593 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 301/572] 10.222.0.57 () {60 vars in 1456 bytes} [Thu Jul 21 23:42:55 2022] DELETE /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments/f06a04eb-6c34-425d-a409-d5b0b0ba71d9 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:42:55.496469 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b03ae0dc-ee03-459f-b74e-7faf9b0daf72 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:55.497417 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b03ae0dc-ee03-459f-b74e-7faf9b0daf72 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:55.503523 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b03ae0dc-ee03-459f-b74e-7faf9b0daf72 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:55.503966 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b03ae0dc-ee03-459f-b74e-7faf9b0daf72 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:55.504723 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b03ae0dc-ee03-459f-b74e-7faf9b0daf72 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:55.505161 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b03ae0dc-ee03-459f-b74e-7faf9b0daf72 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:55.536989 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b03ae0dc-ee03-459f-b74e-7faf9b0daf72 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044956 Jul 21 23:42:55.537958 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 272/573] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jul 21 23:42:55 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 23:42:55.703500 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3a045c16-c433-4c43-9845-da46d0495fd7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:42:55.710025 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3a045c16-c433-4c43-9845-da46d0495fd7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:55.710477 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3a045c16-c433-4c43-9845-da46d0495fd7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:55.733961 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3a045c16-c433-4c43-9845-da46d0495fd7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Going to try to stop instance {{(pid=124388) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 23:42:55.773773 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3a045c16-c433-4c43-9845-da46d0495fd7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "POST /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/action" status: 202 len: 0 microversion: 2.1 time: 0.074291 Jul 21 23:42:55.774392 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 302/574] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:42:55 2022] POST /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:42:55.782968 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6582830e-05ca-4d77-af31-d3c88b80d126 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:55.783572 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6582830e-05ca-4d77-af31-d3c88b80d126 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:55.789522 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6582830e-05ca-4d77-af31-d3c88b80d126 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:55.789972 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6582830e-05ca-4d77-af31-d3c88b80d126 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:55.790870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6582830e-05ca-4d77-af31-d3c88b80d126 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:55.791358 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6582830e-05ca-4d77-af31-d3c88b80d126 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:55.918903 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6582830e-05ca-4d77-af31-d3c88b80d126 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:55.926669 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6582830e-05ca-4d77-af31-d3c88b80d126 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1725 microversion: 2.1 time: 0.147575 Jul 21 23:42:55.927222 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 273/575] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:55 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:56.551179 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6535810a-f5a2-4539-9ffd-e82bad477b9c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:56.552314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6535810a-f5a2-4539-9ffd-e82bad477b9c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:56.560506 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6535810a-f5a2-4539-9ffd-e82bad477b9c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:56.560957 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6535810a-f5a2-4539-9ffd-e82bad477b9c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:56.561750 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6535810a-f5a2-4539-9ffd-e82bad477b9c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:56.562187 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6535810a-f5a2-4539-9ffd-e82bad477b9c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:56.592009 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6535810a-f5a2-4539-9ffd-e82bad477b9c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046109 Jul 21 23:42:56.592478 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 303/576] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jul 21 23:42:56 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:42:56.944252 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b6e5936f-0b9d-4bcc-a7be-ac736b07a074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:56.944791 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b6e5936f-0b9d-4bcc-a7be-ac736b07a074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:56.951301 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6e5936f-0b9d-4bcc-a7be-ac736b07a074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:56.951752 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6e5936f-0b9d-4bcc-a7be-ac736b07a074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:56.952508 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6e5936f-0b9d-4bcc-a7be-ac736b07a074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:56.952945 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b6e5936f-0b9d-4bcc-a7be-ac736b07a074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:57.080680 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b6e5936f-0b9d-4bcc-a7be-ac736b07a074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:57.088021 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b6e5936f-0b9d-4bcc-a7be-ac736b07a074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1679 microversion: 2.1 time: 0.147693 Jul 21 23:42:57.088605 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 274/577] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:56 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:57.604825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-61454c15-b910-4fb6-b3a5-65269007715b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:57.605761 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-61454c15-b910-4fb6-b3a5-65269007715b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:57.612210 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61454c15-b910-4fb6-b3a5-65269007715b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:57.612655 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61454c15-b910-4fb6-b3a5-65269007715b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:57.613479 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61454c15-b910-4fb6-b3a5-65269007715b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:57.613909 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-61454c15-b910-4fb6-b3a5-65269007715b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:57.641827 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-61454c15-b910-4fb6-b3a5-65269007715b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041638 Jul 21 23:42:57.642380 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 304/578] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jul 21 23:42:57 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:42:57.702721 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-75151bd5-6578-4bc0-b82b-37505116a58e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:57.703216 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-75151bd5-6578-4bc0-b82b-37505116a58e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:57.709152 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-75151bd5-6578-4bc0-b82b-37505116a58e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:57.709631 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-75151bd5-6578-4bc0-b82b-37505116a58e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:57.710381 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-75151bd5-6578-4bc0-b82b-37505116a58e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:57.710811 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-75151bd5-6578-4bc0-b82b-37505116a58e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:57.735785 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-75151bd5-6578-4bc0-b82b-37505116a58e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:42:57.809584 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-75151bd5-6578-4bc0-b82b-37505116a58e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "DELETE /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 204 len: 0 microversion: 2.20 time: 0.110161 Jul 21 23:42:57.810719 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 275/579] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jul 21 23:42:57 2022] DELETE /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 23:42:57.819305 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-26832256-c562-4175-9bea-d03224804733 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:57.819998 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-26832256-c562-4175-9bea-d03224804733 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:57.827655 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26832256-c562-4175-9bea-d03224804733 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:57.828106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26832256-c562-4175-9bea-d03224804733 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:57.828880 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26832256-c562-4175-9bea-d03224804733 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:57.829349 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26832256-c562-4175-9bea-d03224804733 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:57.958066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-26832256-c562-4175-9bea-d03224804733 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:57.966193 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-26832256-c562-4175-9bea-d03224804733 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:57.967697 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-26832256-c562-4175-9bea-d03224804733 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:57.968877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-26832256-c562-4175-9bea-d03224804733 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.154112 Jul 21 23:42:57.969480 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 305/580] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:57 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:42:58.106421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5583c3eb-cb22-481f-8425-f6450c931318 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:58.107117 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5583c3eb-cb22-481f-8425-f6450c931318 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:58.113535 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5583c3eb-cb22-481f-8425-f6450c931318 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:58.113979 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5583c3eb-cb22-481f-8425-f6450c931318 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:58.114748 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5583c3eb-cb22-481f-8425-f6450c931318 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:58.115181 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5583c3eb-cb22-481f-8425-f6450c931318 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:58.246779 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5583c3eb-cb22-481f-8425-f6450c931318 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:58.254217 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5583c3eb-cb22-481f-8425-f6450c931318 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1679 microversion: 2.1 time: 0.152665 Jul 21 23:42:58.254778 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 276/581] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:58 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:42:58.987795 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9ce564a4-6edc-4f0a-a6ca-2804a9437a82 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:58.988314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9ce564a4-6edc-4f0a-a6ca-2804a9437a82 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:58.995082 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9ce564a4-6edc-4f0a-a6ca-2804a9437a82 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:58.995523 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9ce564a4-6edc-4f0a-a6ca-2804a9437a82 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:58.996276 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9ce564a4-6edc-4f0a-a6ca-2804a9437a82 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:58.996700 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9ce564a4-6edc-4f0a-a6ca-2804a9437a82 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:59.128761 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9ce564a4-6edc-4f0a-a6ca-2804a9437a82 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:59.137406 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9ce564a4-6edc-4f0a-a6ca-2804a9437a82 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:59.138889 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9ce564a4-6edc-4f0a-a6ca-2804a9437a82 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:59.140024 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9ce564a4-6edc-4f0a-a6ca-2804a9437a82 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.156178 Jul 21 23:42:59.140760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 306/582] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:42:58 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:42:59.271331 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3516187c-91cf-40f2-9953-d4d59664b45f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:42:59.271937 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3516187c-91cf-40f2-9953-d4d59664b45f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:42:59.278483 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3516187c-91cf-40f2-9953-d4d59664b45f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:59.278929 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3516187c-91cf-40f2-9953-d4d59664b45f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:59.279688 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3516187c-91cf-40f2-9953-d4d59664b45f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:42:59.280123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3516187c-91cf-40f2-9953-d4d59664b45f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:42:59.406793 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3516187c-91cf-40f2-9953-d4d59664b45f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:42:59.414103 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3516187c-91cf-40f2-9953-d4d59664b45f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1679 microversion: 2.1 time: 0.146686 Jul 21 23:42:59.414660 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 277/583] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:42:59 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:43:00.163035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-53ba24a6-9015-4355-8e82-fe3b7c4c84c7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:00.163647 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-53ba24a6-9015-4355-8e82-fe3b7c4c84c7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:00.170719 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53ba24a6-9015-4355-8e82-fe3b7c4c84c7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:00.171167 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53ba24a6-9015-4355-8e82-fe3b7c4c84c7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:00.171934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53ba24a6-9015-4355-8e82-fe3b7c4c84c7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:00.172367 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-53ba24a6-9015-4355-8e82-fe3b7c4c84c7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:00.302205 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-53ba24a6-9015-4355-8e82-fe3b7c4c84c7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:00.310707 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-53ba24a6-9015-4355-8e82-fe3b7c4c84c7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:00.312194 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-53ba24a6-9015-4355-8e82-fe3b7c4c84c7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:00.313370 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-53ba24a6-9015-4355-8e82-fe3b7c4c84c7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1722 microversion: 2.20 time: 0.154238 Jul 21 23:43:00.313927 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 307/584] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:00 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:00.432257 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0e43f04a-d0f9-4d2c-8656-c8590c3a0242 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:00.432865 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0e43f04a-d0f9-4d2c-8656-c8590c3a0242 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:00.439804 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e43f04a-d0f9-4d2c-8656-c8590c3a0242 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:00.440250 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e43f04a-d0f9-4d2c-8656-c8590c3a0242 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:00.441242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e43f04a-d0f9-4d2c-8656-c8590c3a0242 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:00.441678 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e43f04a-d0f9-4d2c-8656-c8590c3a0242 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:00.635490 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0e43f04a-d0f9-4d2c-8656-c8590c3a0242 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:00.642978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0e43f04a-d0f9-4d2c-8656-c8590c3a0242 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1679 microversion: 2.1 time: 0.215137 Jul 21 23:43:00.643553 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 278/585] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:00 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:00.966711 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-562f05e8-10dd-4d5e-b053-b8b005333145 req-a9adea2f-0f0c-4b81-b1bd-30ac6b8415b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1e0d18-427a-456e-8ca0-c246e41f1fab", "name": "network-vif-deleted", "tag": "7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:00.975164 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-562f05e8-10dd-4d5e-b053-b8b005333145 req-a9adea2f-0f0c-4b81-b1bd-30ac6b8415b2 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:00.975769 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-562f05e8-10dd-4d5e-b053-b8b005333145 req-a9adea2f-0f0c-4b81-b1bd-30ac6b8415b2 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:00.988543 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-562f05e8-10dd-4d5e-b053-b8b005333145 req-a9adea2f-0f0c-4b81-b1bd-30ac6b8415b2 service nova] Creating event network-vif-deleted:7b13a0d2-b0be-4a1f-8e05-6e8af00fa0b8 for instance eb1e0d18-427a-456e-8ca0-c246e41f1fab on hv-cinder-85070 Jul 21 23:43:00.994982 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-562f05e8-10dd-4d5e-b053-b8b005333145 req-a9adea2f-0f0c-4b81-b1bd-30ac6b8415b2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031972 Jul 21 23:43:00.995590 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 308/586] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:01.331969 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:01.332604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:01.338658 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:01.339098 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:01.339865 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:01.340301 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:01.371974 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:01.372423 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:01.372874 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.objects.instance [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lazy-loading 'fault' on Instance uuid eb1e0d18-427a-456e-8ca0-c246e41f1fab {{(pid=124387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:43:01.421044 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:01.428919 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:01.430505 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:01.432183 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4718a068-606b-4936-9445-35c1415749b2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 200 len: 1370 microversion: 2.20 time: 0.104205 Jul 21 23:43:01.432737 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 279/587] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:01 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:01.662721 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e4ba4886-9ed4-4f40-a4b5-0625847d5c0c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:01.663426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e4ba4886-9ed4-4f40-a4b5-0625847d5c0c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:01.670802 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e4ba4886-9ed4-4f40-a4b5-0625847d5c0c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:01.671437 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e4ba4886-9ed4-4f40-a4b5-0625847d5c0c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:01.672389 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e4ba4886-9ed4-4f40-a4b5-0625847d5c0c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:01.672971 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e4ba4886-9ed4-4f40-a4b5-0625847d5c0c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:01.812487 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e4ba4886-9ed4-4f40-a4b5-0625847d5c0c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:01.820208 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e4ba4886-9ed4-4f40-a4b5-0625847d5c0c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1679 microversion: 2.1 time: 0.163128 Jul 21 23:43:01.820780 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 309/588] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:01 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:43:02.449941 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-723c1755-b433-44ca-bc3d-20ed914fdd67 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:02.450532 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-723c1755-b433-44ca-bc3d-20ed914fdd67 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:02.457044 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-723c1755-b433-44ca-bc3d-20ed914fdd67 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:02.457517 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-723c1755-b433-44ca-bc3d-20ed914fdd67 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:02.458266 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-723c1755-b433-44ca-bc3d-20ed914fdd67 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:02.458694 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-723c1755-b433-44ca-bc3d-20ed914fdd67 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:02.471729 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-723c1755-b433-44ca-bc3d-20ed914fdd67 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] HTTP exception thrown: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-723c1755-b433-44ca-bc3d-20ed914fdd67 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Request method failure captured: Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab HTTP/1.1 Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eN5o0PmrC9o1O3oURR3UVxKax6TLQvPvlzgJ3vm4cXi8uKHCpY9bLHuKbxBpAmRwVaUFgMQpvXjdl46xcX93yjtuNm0wroSmlEIPqFRME8xn4bn1B_Ex6xo55iZu0WN7l-8x5ctcX3xO3zH0Kvt_vfDcAjjcvLp6efj1u8oU5y5NVI Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:43:02.473357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9612b265be6144809add4ce9e14ff6ee", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}] Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 51def40a3de745a99f67c6ef2d2bcbf6 Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:43:02.474938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': 'eb1e0d18-427a-456e-8ca0-c246e41f1fab'} Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:43:02.476017 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:43:02.477604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:02.479491 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-723c1755-b433-44ca-bc3d-20ed914fdd67 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Returning 404 to user: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:43:02.479491 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-723c1755-b433-44ca-bc3d-20ed914fdd67 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 404 len: 111 microversion: 2.20 time: 0.029161 Jul 21 23:43:02.479491 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 280/589] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:02 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:43:02.484599 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fc0e5231-8831-4446-a61d-282cc1767882 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '.version_select at 0x7f7d28ac10d0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:02.502397 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fc0e5231-8831-4446-a61d-282cc1767882 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-868285375" status: 204 len: 0 microversion: 2.20 time: 0.021535 Jul 21 23:43:02.503067 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 310/590] 10.222.0.57 () {60 vars in 1258 bytes} [Thu Jul 21 23:43:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-868285375 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 23:43:02.838473 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9df8fb7b-c086-474c-b066-96f870a6cc98 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:02.839499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9df8fb7b-c086-474c-b066-96f870a6cc98 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:02.845348 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9df8fb7b-c086-474c-b066-96f870a6cc98 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:02.845792 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9df8fb7b-c086-474c-b066-96f870a6cc98 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:02.846545 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9df8fb7b-c086-474c-b066-96f870a6cc98 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:02.846971 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9df8fb7b-c086-474c-b066-96f870a6cc98 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:03.058792 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9df8fb7b-c086-474c-b066-96f870a6cc98 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:03.066477 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9df8fb7b-c086-474c-b066-96f870a6cc98 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1679 microversion: 2.1 time: 0.232333 Jul 21 23:43:03.066966 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 281/591] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:02 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:03.216993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-80b48d8c-f75b-42e0-8ad3-e940a63a4eec tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Action: 'create', calling method: .version_select at 0x7f7d28a4fca0>, body: {"keypair": {"name": "tempest-keypair-130691570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4A+UyS8T4c1bGygiLBIeeMEbyGomKAFQpH/2GZIjw6zSJ2iZX7iMXEG2TZogCuI9GNAdkqMu0DVQIoS/Ai2AGVQ2wPcMcbN6P4yi8F4FOiJprHar2lWOGKGK2LWR65rA=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:03.233536 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-80b48d8c-f75b-42e0-8ad3-e940a63a4eec tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Getting quotas for project 9612b265be6144809add4ce9e14ff6ee. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:43:03.237339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-80b48d8c-f75b-42e0-8ad3-e940a63a4eec tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Getting quotas for user 51def40a3de745a99f67c6ef2d2bcbf6 and project 9612b265be6144809add4ce9e14ff6ee. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:43:03.259429 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-80b48d8c-f75b-42e0-8ad3-e940a63a4eec tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047223 Jul 21 23:43:03.260860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 311/592] 10.222.0.57 () {62 vars in 1199 bytes} [Thu Jul 21 23:43:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 23:43:04.088383 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e5585fdc-90d8-4d9e-82d3-1d556c4f0fb0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:04.088995 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e5585fdc-90d8-4d9e-82d3-1d556c4f0fb0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:04.095191 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e5585fdc-90d8-4d9e-82d3-1d556c4f0fb0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:04.095882 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e5585fdc-90d8-4d9e-82d3-1d556c4f0fb0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:04.096659 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e5585fdc-90d8-4d9e-82d3-1d556c4f0fb0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:04.097101 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e5585fdc-90d8-4d9e-82d3-1d556c4f0fb0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:04.299973 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e5585fdc-90d8-4d9e-82d3-1d556c4f0fb0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:04.308054 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e5585fdc-90d8-4d9e-82d3-1d556c4f0fb0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1679 microversion: 2.1 time: 0.227805 Jul 21 23:43:04.308626 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 282/593] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:04 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1679 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:04.607586 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1639680952", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa056cf4-005e-4995-9d38-6224e7ebccf4"}], "security_groups": [{"name": "tempest-securitygroup--1082395882"}], "key_name": "tempest-keypair-130691570", "user_data": "}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:04.705610 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] validate_networks() for [('fa056cf4-005e-4995-9d38-6224e7ebccf4', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:43:05.076882 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:43:05.077344 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:43:05.077843 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:43:05.078250 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:43:05.078660 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:43:05.087626 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:05.088837 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:05.089668 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:05.090095 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:05.108452 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Getting quotas for project 9612b265be6144809add4ce9e14ff6ee. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:43:05.112330 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Getting quotas for user 51def40a3de745a99f67c6ef2d2bcbf6 and project 9612b265be6144809add4ce9e14ff6ee. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:43:05.124224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:43:05.126502 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:43:05.177474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7151846d-fedc-4e06-8513-41ad8622bad5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.575290 Jul 21 23:43:05.178135 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 312/594] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jul 21 23:43:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 23:43:05.188917 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-48b04eec-a582-4005-8016-555f421179ec tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:05.189556 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-48b04eec-a582-4005-8016-555f421179ec tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:05.191943 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:05.247329 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-48b04eec-a582-4005-8016-555f421179ec tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:05.254524 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-48b04eec-a582-4005-8016-555f421179ec tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:05.256030 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-48b04eec-a582-4005-8016-555f421179ec tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:05.257131 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-48b04eec-a582-4005-8016-555f421179ec tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1281 microversion: 2.20 time: 0.072083 Jul 21 23:43:05.257718 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 283/595] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:05 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:05.325778 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-035b180a-3fb7-4855-b7f4-c5eba84c6a38 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:05.326393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-035b180a-3fb7-4855-b7f4-c5eba84c6a38 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:05.332664 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-035b180a-3fb7-4855-b7f4-c5eba84c6a38 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:05.333210 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-035b180a-3fb7-4855-b7f4-c5eba84c6a38 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:05.333977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-035b180a-3fb7-4855-b7f4-c5eba84c6a38 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:05.334410 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-035b180a-3fb7-4855-b7f4-c5eba84c6a38 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:05.471824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-035b180a-3fb7-4855-b7f4-c5eba84c6a38 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:05.479873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-035b180a-3fb7-4855-b7f4-c5eba84c6a38 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1679 microversion: 2.1 time: 0.158831 Jul 21 23:43:05.480810 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 313/596] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:05 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:06.276479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9499b79a-bdd5-4f85-a6d3-5c9faf393668 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:06.277095 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9499b79a-bdd5-4f85-a6d3-5c9faf393668 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:06.283804 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9499b79a-bdd5-4f85-a6d3-5c9faf393668 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:06.284252 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9499b79a-bdd5-4f85-a6d3-5c9faf393668 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:06.285022 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9499b79a-bdd5-4f85-a6d3-5c9faf393668 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:06.285487 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9499b79a-bdd5-4f85-a6d3-5c9faf393668 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:06.376082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9499b79a-bdd5-4f85-a6d3-5c9faf393668 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:06.384784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9499b79a-bdd5-4f85-a6d3-5c9faf393668 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:06.386357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9499b79a-bdd5-4f85-a6d3-5c9faf393668 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:06.387471 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9499b79a-bdd5-4f85-a6d3-5c9faf393668 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1351 microversion: 2.20 time: 0.115456 Jul 21 23:43:06.388019 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 284/597] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:06 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:06.498106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c6fe1757-c2d8-4b0b-b66c-4ced01ccf7f1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:06.498800 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c6fe1757-c2d8-4b0b-b66c-4ced01ccf7f1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:06.505708 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c6fe1757-c2d8-4b0b-b66c-4ced01ccf7f1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:06.506156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c6fe1757-c2d8-4b0b-b66c-4ced01ccf7f1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:06.506920 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c6fe1757-c2d8-4b0b-b66c-4ced01ccf7f1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:06.507349 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c6fe1757-c2d8-4b0b-b66c-4ced01ccf7f1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:06.649899 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c6fe1757-c2d8-4b0b-b66c-4ced01ccf7f1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:06.657472 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c6fe1757-c2d8-4b0b-b66c-4ced01ccf7f1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1656 microversion: 2.1 time: 0.164665 Jul 21 23:43:06.658036 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 314/598] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:06 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1656 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:06.674455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8d2269e3-1c8a-4efc-bc6f-a8612330f266 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:06.680716 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8d2269e3-1c8a-4efc-bc6f-a8612330f266 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:06.681161 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8d2269e3-1c8a-4efc-bc6f-a8612330f266 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:06.705694 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8d2269e3-1c8a-4efc-bc6f-a8612330f266 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Going to try to start instance {{(pid=124387) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 23:43:06.751829 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8d2269e3-1c8a-4efc-bc6f-a8612330f266 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "POST /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/action" status: 202 len: 0 microversion: 2.1 time: 0.081330 Jul 21 23:43:06.752679 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 285/599] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:43:06 2022] POST /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:43:06.761204 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f538630f-11ed-4ec0-ab45-d2430d5da0ba tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:06.762013 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f538630f-11ed-4ec0-ab45-d2430d5da0ba tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:06.768570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f538630f-11ed-4ec0-ab45-d2430d5da0ba tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:06.769015 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f538630f-11ed-4ec0-ab45-d2430d5da0ba tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:06.769895 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f538630f-11ed-4ec0-ab45-d2430d5da0ba tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:06.770348 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f538630f-11ed-4ec0-ab45-d2430d5da0ba tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:06.928102 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f538630f-11ed-4ec0-ab45-d2430d5da0ba tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:06.935852 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f538630f-11ed-4ec0-ab45-d2430d5da0ba tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1665 microversion: 2.1 time: 0.178730 Jul 21 23:43:06.936430 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 315/600] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:06 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1665 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:07.407810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e073eab9-9867-418f-bdf0-14d07d59d32a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:07.408510 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e073eab9-9867-418f-bdf0-14d07d59d32a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:07.415112 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e073eab9-9867-418f-bdf0-14d07d59d32a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:07.415570 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e073eab9-9867-418f-bdf0-14d07d59d32a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:07.417103 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e073eab9-9867-418f-bdf0-14d07d59d32a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:07.417557 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e073eab9-9867-418f-bdf0-14d07d59d32a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:07.421615 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:07.945383 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e073eab9-9867-418f-bdf0-14d07d59d32a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:07.954230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8156ad6e-7398-46a7-ab32-5b349ca2c7c1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:07.954775 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e073eab9-9867-418f-bdf0-14d07d59d32a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:07.955160 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8156ad6e-7398-46a7-ab32-5b349ca2c7c1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:07.955721 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e073eab9-9867-418f-bdf0-14d07d59d32a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:07.956824 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e073eab9-9867-418f-bdf0-14d07d59d32a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1407 microversion: 2.20 time: 0.554379 Jul 21 23:43:07.957577 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 286/601] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:07 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:07.961997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8156ad6e-7398-46a7-ab32-5b349ca2c7c1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:07.962443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8156ad6e-7398-46a7-ab32-5b349ca2c7c1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:07.964084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8156ad6e-7398-46a7-ab32-5b349ca2c7c1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:07.964520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8156ad6e-7398-46a7-ab32-5b349ca2c7c1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:08.108279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8156ad6e-7398-46a7-ab32-5b349ca2c7c1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:08.117839 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8156ad6e-7398-46a7-ab32-5b349ca2c7c1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1665 microversion: 2.1 time: 0.167024 Jul 21 23:43:08.118630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 316/602] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:07 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:08.346039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-98f6c4dc-d3d9-49a7-b126-22ee9ff153b8 req-a3ca1ea3-8bb5-4b10-89f4-bd1fd6188ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c3804b-cf30-461e-8f8c-30250027a445", "tag": "dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:08.356184 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-98f6c4dc-d3d9-49a7-b126-22ee9ff153b8 req-a3ca1ea3-8bb5-4b10-89f4-bd1fd6188ac1 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:08.357083 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-98f6c4dc-d3d9-49a7-b126-22ee9ff153b8 req-a3ca1ea3-8bb5-4b10-89f4-bd1fd6188ac1 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:08.373574 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-98f6c4dc-d3d9-49a7-b126-22ee9ff153b8 req-a3ca1ea3-8bb5-4b10-89f4-bd1fd6188ac1 service nova] Creating event network-changed:dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e for instance a8c3804b-cf30-461e-8f8c-30250027a445 on hv-cinder-85070 Jul 21 23:43:08.378321 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-98f6c4dc-d3d9-49a7-b126-22ee9ff153b8 req-a3ca1ea3-8bb5-4b10-89f4-bd1fd6188ac1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038296 Jul 21 23:43:08.378914 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 287/603] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:08.976351 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-58633aea-4a40-4ffd-92f9-c6cf5cc6bf77 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:08.976945 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-58633aea-4a40-4ffd-92f9-c6cf5cc6bf77 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:08.983747 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-58633aea-4a40-4ffd-92f9-c6cf5cc6bf77 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:08.984187 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-58633aea-4a40-4ffd-92f9-c6cf5cc6bf77 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:08.984933 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-58633aea-4a40-4ffd-92f9-c6cf5cc6bf77 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:08.985407 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-58633aea-4a40-4ffd-92f9-c6cf5cc6bf77 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:09.004137 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:09.122988 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-58633aea-4a40-4ffd-92f9-c6cf5cc6bf77 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:09.132809 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-58633aea-4a40-4ffd-92f9-c6cf5cc6bf77 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:09.135426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-58633aea-4a40-4ffd-92f9-c6cf5cc6bf77 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:09.136833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-58633aea-4a40-4ffd-92f9-c6cf5cc6bf77 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1407 microversion: 2.20 time: 0.164341 Jul 21 23:43:09.137663 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 317/604] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:08 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:09.138041 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ecf85b56-31cb-441c-ba8b-7e65f3539877 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:09.139514 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ecf85b56-31cb-441c-ba8b-7e65f3539877 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:09.145984 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ecf85b56-31cb-441c-ba8b-7e65f3539877 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:09.146438 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ecf85b56-31cb-441c-ba8b-7e65f3539877 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:09.147199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ecf85b56-31cb-441c-ba8b-7e65f3539877 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:09.147630 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ecf85b56-31cb-441c-ba8b-7e65f3539877 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:09.375014 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ecf85b56-31cb-441c-ba8b-7e65f3539877 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:09.382649 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ecf85b56-31cb-441c-ba8b-7e65f3539877 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1669 microversion: 2.1 time: 0.251517 Jul 21 23:43:09.383212 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 288/605] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:09 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1669 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:43:10.155485 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-64e272c7-8130-4003-a427-b8c1c409a5aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:10.156099 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-64e272c7-8130-4003-a427-b8c1c409a5aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:10.162584 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-64e272c7-8130-4003-a427-b8c1c409a5aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:10.163031 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-64e272c7-8130-4003-a427-b8c1c409a5aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:10.163782 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-64e272c7-8130-4003-a427-b8c1c409a5aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:10.164215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-64e272c7-8130-4003-a427-b8c1c409a5aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:10.296400 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-64e272c7-8130-4003-a427-b8c1c409a5aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:10.304194 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-64e272c7-8130-4003-a427-b8c1c409a5aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:10.305718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-64e272c7-8130-4003-a427-b8c1c409a5aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:10.307737 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-64e272c7-8130-4003-a427-b8c1c409a5aa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1407 microversion: 2.20 time: 0.155844 Jul 21 23:43:10.308300 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 318/606] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:10 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:11.325809 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b027699d-8d2b-4e8e-958e-e62604f887b4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:11.326428 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b027699d-8d2b-4e8e-958e-e62604f887b4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:11.333961 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b027699d-8d2b-4e8e-958e-e62604f887b4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:11.334410 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b027699d-8d2b-4e8e-958e-e62604f887b4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:11.335176 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b027699d-8d2b-4e8e-958e-e62604f887b4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:11.335610 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b027699d-8d2b-4e8e-958e-e62604f887b4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:11.468155 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b027699d-8d2b-4e8e-958e-e62604f887b4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:11.477279 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b027699d-8d2b-4e8e-958e-e62604f887b4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:11.479589 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b027699d-8d2b-4e8e-958e-e62604f887b4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:11.480909 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b027699d-8d2b-4e8e-958e-e62604f887b4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1407 microversion: 2.20 time: 0.159155 Jul 21 23:43:11.481499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 289/607] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:11 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:12.499630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-11863105-9a34-4f02-b018-69a4691b79db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:12.500286 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-11863105-9a34-4f02-b018-69a4691b79db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:12.510976 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11863105-9a34-4f02-b018-69a4691b79db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:12.511488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11863105-9a34-4f02-b018-69a4691b79db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:12.512264 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11863105-9a34-4f02-b018-69a4691b79db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:12.512691 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11863105-9a34-4f02-b018-69a4691b79db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:12.639745 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-11863105-9a34-4f02-b018-69a4691b79db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:12.647559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-11863105-9a34-4f02-b018-69a4691b79db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:12.649058 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-11863105-9a34-4f02-b018-69a4691b79db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:12.650691 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-11863105-9a34-4f02-b018-69a4691b79db tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1407 microversion: 2.20 time: 0.154419 Jul 21 23:43:12.651245 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 319/608] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:12 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:13.669199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8a25503f-7de1-4ce9-876a-9b7f61cc95bb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:13.669964 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8a25503f-7de1-4ce9-876a-9b7f61cc95bb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:13.676765 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8a25503f-7de1-4ce9-876a-9b7f61cc95bb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:13.677224 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8a25503f-7de1-4ce9-876a-9b7f61cc95bb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:13.678000 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8a25503f-7de1-4ce9-876a-9b7f61cc95bb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:13.678434 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8a25503f-7de1-4ce9-876a-9b7f61cc95bb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:13.815796 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-8a25503f-7de1-4ce9-876a-9b7f61cc95bb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:13.824815 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-8a25503f-7de1-4ce9-876a-9b7f61cc95bb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:13.826370 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-8a25503f-7de1-4ce9-876a-9b7f61cc95bb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:13.827485 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8a25503f-7de1-4ce9-876a-9b7f61cc95bb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1407 microversion: 2.20 time: 0.163189 Jul 21 23:43:13.828032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 290/609] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:13 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:13.847599 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-2635682b-c811-43cf-bfc2-db655cf03e39 req-b4879b41-1af9-4025-ae8f-e52d2ee200c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c3804b-cf30-461e-8f8c-30250027a445", "name": "network-vif-plugged", "status": "completed", "tag": "dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:13.856748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-2635682b-c811-43cf-bfc2-db655cf03e39 req-b4879b41-1af9-4025-ae8f-e52d2ee200c5 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:13.857241 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-2635682b-c811-43cf-bfc2-db655cf03e39 req-b4879b41-1af9-4025-ae8f-e52d2ee200c5 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:13.870095 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-2635682b-c811-43cf-bfc2-db655cf03e39 req-b4879b41-1af9-4025-ae8f-e52d2ee200c5 service nova] Creating event network-vif-plugged:dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e for instance a8c3804b-cf30-461e-8f8c-30250027a445 on hv-cinder-85070 Jul 21 23:43:13.875316 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-2635682b-c811-43cf-bfc2-db655cf03e39 req-b4879b41-1af9-4025-ae8f-e52d2ee200c5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031330 Jul 21 23:43:13.876127 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 320/610] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:14.846569 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1c80c9d4-4d4d-40a1-92eb-ddb61bf1c3ce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:14.847119 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1c80c9d4-4d4d-40a1-92eb-ddb61bf1c3ce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:14.854114 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c80c9d4-4d4d-40a1-92eb-ddb61bf1c3ce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:14.854570 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c80c9d4-4d4d-40a1-92eb-ddb61bf1c3ce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:14.855319 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c80c9d4-4d4d-40a1-92eb-ddb61bf1c3ce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:14.855750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c80c9d4-4d4d-40a1-92eb-ddb61bf1c3ce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:14.983913 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1c80c9d4-4d4d-40a1-92eb-ddb61bf1c3ce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:14.992011 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1c80c9d4-4d4d-40a1-92eb-ddb61bf1c3ce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:14.993536 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1c80c9d4-4d4d-40a1-92eb-ddb61bf1c3ce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:14.995195 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1c80c9d4-4d4d-40a1-92eb-ddb61bf1c3ce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1407 microversion: 2.20 time: 0.152615 Jul 21 23:43:14.995785 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 291/611] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:14 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:16.014262 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f2023622-5251-4ac9-b4f5-78335c892118 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:16.015012 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f2023622-5251-4ac9-b4f5-78335c892118 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:16.017400 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:16.018244 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=10 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:16.024209 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f2023622-5251-4ac9-b4f5-78335c892118 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:16.024663 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f2023622-5251-4ac9-b4f5-78335c892118 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:16.025467 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f2023622-5251-4ac9-b4f5-78335c892118 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:16.026586 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f2023622-5251-4ac9-b4f5-78335c892118 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:16.157534 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f2023622-5251-4ac9-b4f5-78335c892118 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:16.165418 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f2023622-5251-4ac9-b4f5-78335c892118 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:16.167152 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f2023622-5251-4ac9-b4f5-78335c892118 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:16.168294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f2023622-5251-4ac9-b4f5-78335c892118 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1599 microversion: 2.20 time: 0.159030 Jul 21 23:43:16.168845 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 321/612] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:43:16 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:43:16.185823 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a6bcda79-508e-43bb-9feb-3efc308a9ecb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:16.186356 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-a6bcda79-508e-43bb-9feb-3efc308a9ecb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:16.188277 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:16.193975 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a6bcda79-508e-43bb-9feb-3efc308a9ecb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:16.194433 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a6bcda79-508e-43bb-9feb-3efc308a9ecb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:16.195195 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a6bcda79-508e-43bb-9feb-3efc308a9ecb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:16.195633 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a6bcda79-508e-43bb-9feb-3efc308a9ecb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:16.277250 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a6bcda79-508e-43bb-9feb-3efc308a9ecb tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095303 Jul 21 23:43:16.277846 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 292/613] 10.222.0.57 () {60 vars in 1315 bytes} [Thu Jul 21 23:43:16 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:43:17.199437 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-db8659b4-694f-4f72-959f-e106f91fb19d req-bee47bfa-70ab-412f-b0e6-b19f2b246643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c3804b-cf30-461e-8f8c-30250027a445", "tag": "dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:17.207933 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-db8659b4-694f-4f72-959f-e106f91fb19d req-bee47bfa-70ab-412f-b0e6-b19f2b246643 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:17.208705 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-db8659b4-694f-4f72-959f-e106f91fb19d req-bee47bfa-70ab-412f-b0e6-b19f2b246643 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:17.220538 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-db8659b4-694f-4f72-959f-e106f91fb19d req-bee47bfa-70ab-412f-b0e6-b19f2b246643 service nova] Creating event network-changed:dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e for instance a8c3804b-cf30-461e-8f8c-30250027a445 on hv-cinder-85070 Jul 21 23:43:17.225996 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-db8659b4-694f-4f72-959f-e106f91fb19d req-bee47bfa-70ab-412f-b0e6-b19f2b246643 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030181 Jul 21 23:43:17.226850 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 322/614] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:17.816942 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-23f3d366-1708-4b51-aeb5-888d8333aa95 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:17.817510 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-23f3d366-1708-4b51-aeb5-888d8333aa95 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:17.823474 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-23f3d366-1708-4b51-aeb5-888d8333aa95 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:17.823919 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-23f3d366-1708-4b51-aeb5-888d8333aa95 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:17.824679 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-23f3d366-1708-4b51-aeb5-888d8333aa95 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:17.825124 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-23f3d366-1708-4b51-aeb5-888d8333aa95 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:17.848855 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-23f3d366-1708-4b51-aeb5-888d8333aa95 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/ips" status: 200 len: 151 microversion: 2.1 time: 0.036284 Jul 21 23:43:17.849473 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 293/615] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 23:43:17 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:19.200280 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-156c845b-e3a3-490b-9167-fa04360aeaa4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:19.201454 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-156c845b-e3a3-490b-9167-fa04360aeaa4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:19.207642 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-156c845b-e3a3-490b-9167-fa04360aeaa4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:19.208085 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-156c845b-e3a3-490b-9167-fa04360aeaa4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:19.208858 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-156c845b-e3a3-490b-9167-fa04360aeaa4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:19.209299 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-156c845b-e3a3-490b-9167-fa04360aeaa4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:19.453843 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-156c845b-e3a3-490b-9167-fa04360aeaa4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258704 Jul 21 23:43:19.454558 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 323/616] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:43:19 2022] POST /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:26.939721 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5ad0702b-5a33-4f9e-8ce3-c57647f339a0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc"}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:26.940816 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5ad0702b-5a33-4f9e-8ce3-c57647f339a0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:26.947435 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5ad0702b-5a33-4f9e-8ce3-c57647f339a0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:26.947883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5ad0702b-5a33-4f9e-8ce3-c57647f339a0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:26.948638 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5ad0702b-5a33-4f9e-8ce3-c57647f339a0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:26.949073 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5ad0702b-5a33-4f9e-8ce3-c57647f339a0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:27.026000 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-5ad0702b-5a33-4f9e-8ce3-c57647f339a0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Invalid volume: volume 93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc is already attached to instances: 8d749247-571b-427e-83af-e7b9a7c3894d Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5ad0702b-5a33-4f9e-8ce3-c57647f339a0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: POST /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-volume_attachments HTTP/1.1 Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 74 Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:43:27.027715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {"volumeAttachment": {"volumeId": "93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc"}} Jul 21 23:43:27.029489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Invalid volume: volume 93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc is already attached to instances: 8d749247-571b-427e-83af-e7b9a7c3894d Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'server_id': '8d749247-571b-427e-83af-e7b9a7c3894d', 'body': {'volumeAttachment': {'volumeId': '93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc'}}} Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc is already attached to instances: 8d749247-571b-427e-83af-e7b9a7c3894d Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:27.030350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc is already attached to instances: 8d749247-571b-427e-83af-e7b9a7c3894d Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:27.031905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:27.033404 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:27.033404 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:43:27.033404 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:43:27.033404 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc is already attached to instances: 8d749247-571b-427e-83af-e7b9a7c3894d Jul 21 23:43:27.033404 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:27.033404 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5ad0702b-5a33-4f9e-8ce3-c57647f339a0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 400 to user: Invalid volume: volume 93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc is already attached to instances: 8d749247-571b-427e-83af-e7b9a7c3894d {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:43:27.033404 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5ad0702b-5a33-4f9e-8ce3-c57647f339a0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094232 Jul 21 23:43:27.033404 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 294/617] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:43:26 2022] POST /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:43:27.090200 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7f6352c0-730a-4867-8af2-172d2f39948a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:27.090717 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7f6352c0-730a-4867-8af2-172d2f39948a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:27.093150 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:27.098787 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f6352c0-730a-4867-8af2-172d2f39948a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:27.099240 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f6352c0-730a-4867-8af2-172d2f39948a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:27.100007 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f6352c0-730a-4867-8af2-172d2f39948a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:27.100444 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7f6352c0-730a-4867-8af2-172d2f39948a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:27.180773 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-7f6352c0-730a-4867-8af2-172d2f39948a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lazy-loading 'services' on Instance uuid 8d749247-571b-427e-83af-e7b9a7c3894d {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:43:27.254234 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7f6352c0-730a-4867-8af2-172d2f39948a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-volume_attachments/93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc" status: 202 len: 0 microversion: 2.1 time: 0.168892 Jul 21 23:43:27.254896 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 324/618] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:43:27 2022] DELETE /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-volume_attachments/93fd0a08-5349-4201-a9fe-cfa5c0f2bcdc => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:43:27.264043 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4d179d41-1a2c-4604-9ca5-37d68115577c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:27.265030 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4d179d41-1a2c-4604-9ca5-37d68115577c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:27.272840 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4d179d41-1a2c-4604-9ca5-37d68115577c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:27.273835 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4d179d41-1a2c-4604-9ca5-37d68115577c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:27.274670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4d179d41-1a2c-4604-9ca5-37d68115577c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:27.275236 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4d179d41-1a2c-4604-9ca5-37d68115577c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:27.309080 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4d179d41-1a2c-4604-9ca5-37d68115577c tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049849 Jul 21 23:43:27.309666 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 295/619] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:43:27 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:28.320489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-11c38472-e71b-49d0-a5ac-0137c39e5267 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:28.321582 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-11c38472-e71b-49d0-a5ac-0137c39e5267 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:28.328352 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11c38472-e71b-49d0-a5ac-0137c39e5267 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:28.328798 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11c38472-e71b-49d0-a5ac-0137c39e5267 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:28.329596 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11c38472-e71b-49d0-a5ac-0137c39e5267 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:28.330104 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11c38472-e71b-49d0-a5ac-0137c39e5267 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:28.359785 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-11c38472-e71b-49d0-a5ac-0137c39e5267 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043632 Jul 21 23:43:28.360338 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 325/620] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:43:28 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:43:28.417397 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9c3e56a4-6b6d-468d-9d62-d448798cf430 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:28.417902 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9c3e56a4-6b6d-468d-9d62-d448798cf430 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:28.424937 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9c3e56a4-6b6d-468d-9d62-d448798cf430 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:28.425429 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9c3e56a4-6b6d-468d-9d62-d448798cf430 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:28.426187 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9c3e56a4-6b6d-468d-9d62-d448798cf430 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:28.426623 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9c3e56a4-6b6d-468d-9d62-d448798cf430 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:28.453042 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9c3e56a4-6b6d-468d-9d62-d448798cf430 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:43:28.528619 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9c3e56a4-6b6d-468d-9d62-d448798cf430 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 204 len: 0 microversion: 2.1 time: 0.114693 Jul 21 23:43:28.529479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 296/621] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:43:28 2022] DELETE /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:43:28.537484 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bc48dee1-ba64-4669-9605-fc3d3bf8c7f8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:28.538126 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bc48dee1-ba64-4669-9605-fc3d3bf8c7f8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:28.544025 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bc48dee1-ba64-4669-9605-fc3d3bf8c7f8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:28.545103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bc48dee1-ba64-4669-9605-fc3d3bf8c7f8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:28.545951 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bc48dee1-ba64-4669-9605-fc3d3bf8c7f8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:28.546379 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bc48dee1-ba64-4669-9605-fc3d3bf8c7f8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:28.687068 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6d60151d-5cf0-426e-a934-8adae4bf0f8d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:28.687653 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6d60151d-5cf0-426e-a934-8adae4bf0f8d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:28.693623 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d60151d-5cf0-426e-a934-8adae4bf0f8d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:28.694076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d60151d-5cf0-426e-a934-8adae4bf0f8d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:28.694844 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d60151d-5cf0-426e-a934-8adae4bf0f8d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:28.695287 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d60151d-5cf0-426e-a934-8adae4bf0f8d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:28.776853 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.objects.instance [None req-6d60151d-5cf0-426e-a934-8adae4bf0f8d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lazy-loading 'services' on Instance uuid c9b1ede1-a46a-454d-9b81-5b06de1124e9 {{(pid=124387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:43:28.801661 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bc48dee1-ba64-4669-9605-fc3d3bf8c7f8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:28.808954 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bc48dee1-ba64-4669-9605-fc3d3bf8c7f8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1682 microversion: 2.1 time: 0.275226 Jul 21 23:43:28.809551 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 326/622] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:28 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1682 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:43:28.886881 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6d60151d-5cf0-426e-a934-8adae4bf0f8d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments/bc7f06e4-37b6-4899-9ab2-5eb594f4b0c9" status: 202 len: 0 microversion: 2.1 time: 0.203806 Jul 21 23:43:28.887885 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 297/623] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:43:28 2022] DELETE /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments/bc7f06e4-37b6-4899-9ab2-5eb594f4b0c9 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:43:28.896803 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cd9585d9-d0c8-4dcf-a1fe-11a25470aa96 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:28.897833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cd9585d9-d0c8-4dcf-a1fe-11a25470aa96 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:28.904750 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cd9585d9-d0c8-4dcf-a1fe-11a25470aa96 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:28.905164 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cd9585d9-d0c8-4dcf-a1fe-11a25470aa96 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:28.905916 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cd9585d9-d0c8-4dcf-a1fe-11a25470aa96 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:28.906343 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cd9585d9-d0c8-4dcf-a1fe-11a25470aa96 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:28.936440 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cd9585d9-d0c8-4dcf-a1fe-11a25470aa96 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043613 Jul 21 23:43:28.936978 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 327/624] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:43:28 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:29.827443 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1f344572-1538-4d8a-9db8-870fd15b1548 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:29.828157 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1f344572-1538-4d8a-9db8-870fd15b1548 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:29.834342 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1f344572-1538-4d8a-9db8-870fd15b1548 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:29.834798 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1f344572-1538-4d8a-9db8-870fd15b1548 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:29.835552 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1f344572-1538-4d8a-9db8-870fd15b1548 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:29.835986 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1f344572-1538-4d8a-9db8-870fd15b1548 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:29.948013 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ce48568c-f1f5-4cda-8f5c-4613b7b34735 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:29.948945 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ce48568c-f1f5-4cda-8f5c-4613b7b34735 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:29.955777 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce48568c-f1f5-4cda-8f5c-4613b7b34735 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:29.956137 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce48568c-f1f5-4cda-8f5c-4613b7b34735 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:29.956913 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce48568c-f1f5-4cda-8f5c-4613b7b34735 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:29.957384 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce48568c-f1f5-4cda-8f5c-4613b7b34735 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:29.987268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ce48568c-f1f5-4cda-8f5c-4613b7b34735 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043156 Jul 21 23:43:29.987842 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 328/625] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:43:29 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:43:30.025209 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1f344572-1538-4d8a-9db8-870fd15b1548 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:30.033682 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1f344572-1538-4d8a-9db8-870fd15b1548 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1682 microversion: 2.1 time: 0.210580 Jul 21 23:43:30.034260 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 298/626] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:29 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:30.999216 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bd3d8eb3-c457-45b4-bd5b-9baaa7eb3990 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:31.000197 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bd3d8eb3-c457-45b4-bd5b-9baaa7eb3990 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:31.007188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd3d8eb3-c457-45b4-bd5b-9baaa7eb3990 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:31.008010 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd3d8eb3-c457-45b4-bd5b-9baaa7eb3990 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:31.008799 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd3d8eb3-c457-45b4-bd5b-9baaa7eb3990 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:31.009265 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bd3d8eb3-c457-45b4-bd5b-9baaa7eb3990 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:31.052405 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-94abe021-c692-4822-b5f9-7eda57e19f23 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:31.053791 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-94abe021-c692-4822-b5f9-7eda57e19f23 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:31.062374 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-94abe021-c692-4822-b5f9-7eda57e19f23 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:31.063178 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-94abe021-c692-4822-b5f9-7eda57e19f23 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:31.063933 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bd3d8eb3-c457-45b4-bd5b-9baaa7eb3990 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069466 Jul 21 23:43:31.064363 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-94abe021-c692-4822-b5f9-7eda57e19f23 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:31.065106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-94abe021-c692-4822-b5f9-7eda57e19f23 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:31.070071 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 329/627] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:43:30 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:43:31.156384 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3eb6578f-50fd-40a1-854b-8bce7270af69 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:31.156782 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3eb6578f-50fd-40a1-854b-8bce7270af69 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:31.163026 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3eb6578f-50fd-40a1-854b-8bce7270af69 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:31.163559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3eb6578f-50fd-40a1-854b-8bce7270af69 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:31.164493 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3eb6578f-50fd-40a1-854b-8bce7270af69 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:31.164971 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3eb6578f-50fd-40a1-854b-8bce7270af69 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:31.190402 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3eb6578f-50fd-40a1-854b-8bce7270af69 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:43:31.269398 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3eb6578f-50fd-40a1-854b-8bce7270af69 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 204 len: 0 microversion: 2.1 time: 0.116359 Jul 21 23:43:31.270772 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 330/628] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:43:31 2022] DELETE /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 23:43:31.281872 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8b8cb86b-d713-42b8-863c-abbcbabcc18c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:31.282570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8b8cb86b-d713-42b8-863c-abbcbabcc18c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:31.295124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b8cb86b-d713-42b8-863c-abbcbabcc18c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:31.295570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b8cb86b-d713-42b8-863c-abbcbabcc18c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:31.296332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b8cb86b-d713-42b8-863c-abbcbabcc18c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:31.296760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8b8cb86b-d713-42b8-863c-abbcbabcc18c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:31.351584 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-94abe021-c692-4822-b5f9-7eda57e19f23 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:31.359757 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-94abe021-c692-4822-b5f9-7eda57e19f23 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1682 microversion: 2.1 time: 0.311783 Jul 21 23:43:31.360327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 299/629] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:31 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1682 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:31.429062 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8b8cb86b-d713-42b8-863c-abbcbabcc18c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:31.432629 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:31.437812 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8b8cb86b-d713-42b8-863c-abbcbabcc18c tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1688 microversion: 2.1 time: 0.161741 Jul 21 23:43:31.438384 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 331/630] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:31 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:31.904051 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-d2a56231-abd2-489f-a6bc-ea51c8d0865f req-aeda8bf9-b3d0-43ee-a0c3-aaf4ef507c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d749247-571b-427e-83af-e7b9a7c3894d", "name": "network-vif-deleted", "tag": "2620f97b-ffd2-4d54-91c5-27106fd73ada"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:31.912784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-d2a56231-abd2-489f-a6bc-ea51c8d0865f req-aeda8bf9-b3d0-43ee-a0c3-aaf4ef507c44 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:31.913323 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-d2a56231-abd2-489f-a6bc-ea51c8d0865f req-aeda8bf9-b3d0-43ee-a0c3-aaf4ef507c44 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:31.925984 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-d2a56231-abd2-489f-a6bc-ea51c8d0865f req-aeda8bf9-b3d0-43ee-a0c3-aaf4ef507c44 service nova] Creating event network-vif-deleted:2620f97b-ffd2-4d54-91c5-27106fd73ada for instance 8d749247-571b-427e-83af-e7b9a7c3894d on hv-cinder-85070 Jul 21 23:43:31.930920 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-d2a56231-abd2-489f-a6bc-ea51c8d0865f req-aeda8bf9-b3d0-43ee-a0c3-aaf4ef507c44 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030529 Jul 21 23:43:31.931525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 300/631] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:32.378549 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-65aaf1fb-26db-4f18-85c4-0a600f73ad22 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:32.379284 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-65aaf1fb-26db-4f18-85c4-0a600f73ad22 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:32.389073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-65aaf1fb-26db-4f18-85c4-0a600f73ad22 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:32.389597 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-65aaf1fb-26db-4f18-85c4-0a600f73ad22 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:32.390361 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-65aaf1fb-26db-4f18-85c4-0a600f73ad22 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:32.390789 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-65aaf1fb-26db-4f18-85c4-0a600f73ad22 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:32.454220 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-65aaf1fb-26db-4f18-85c4-0a600f73ad22 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:32.455673 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-fde5da75-2613-4d3b-9d89-6ad15bfb732a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:32.456643 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-fde5da75-2613-4d3b-9d89-6ad15bfb732a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:32.462505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-65aaf1fb-26db-4f18-85c4-0a600f73ad22 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1615 microversion: 2.1 time: 0.088695 Jul 21 23:43:32.463591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fde5da75-2613-4d3b-9d89-6ad15bfb732a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:32.464055 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fde5da75-2613-4d3b-9d89-6ad15bfb732a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:32.464859 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fde5da75-2613-4d3b-9d89-6ad15bfb732a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:32.465323 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fde5da75-2613-4d3b-9d89-6ad15bfb732a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:32.471652 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 332/632] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:32 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1615 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:32.604316 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-fde5da75-2613-4d3b-9d89-6ad15bfb732a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:32.613129 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-fde5da75-2613-4d3b-9d89-6ad15bfb732a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1688 microversion: 2.1 time: 0.161662 Jul 21 23:43:32.613721 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 301/633] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:32 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:43:33.480039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9b866a41-3bbc-4859-abb7-1ddc2bcce736 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:33.480590 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9b866a41-3bbc-4859-abb7-1ddc2bcce736 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:33.487561 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b866a41-3bbc-4859-abb7-1ddc2bcce736 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:33.488009 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b866a41-3bbc-4859-abb7-1ddc2bcce736 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:33.488812 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b866a41-3bbc-4859-abb7-1ddc2bcce736 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:33.489281 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b866a41-3bbc-4859-abb7-1ddc2bcce736 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:33.554929 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9b866a41-3bbc-4859-abb7-1ddc2bcce736 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:33.563106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9b866a41-3bbc-4859-abb7-1ddc2bcce736 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1615 microversion: 2.1 time: 0.087057 Jul 21 23:43:33.563677 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 333/634] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:33 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:33.630334 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-454997e8-0112-4c81-97a4-7b9245d0219f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:33.630930 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-454997e8-0112-4c81-97a4-7b9245d0219f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:33.637604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-454997e8-0112-4c81-97a4-7b9245d0219f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:33.638103 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-454997e8-0112-4c81-97a4-7b9245d0219f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:33.638873 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-454997e8-0112-4c81-97a4-7b9245d0219f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:33.639297 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-454997e8-0112-4c81-97a4-7b9245d0219f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:33.656951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:33.771467 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-454997e8-0112-4c81-97a4-7b9245d0219f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:33.778997 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-454997e8-0112-4c81-97a4-7b9245d0219f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1688 microversion: 2.1 time: 0.152522 Jul 21 23:43:33.779777 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 302/635] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:33 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:34.549955 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:43:34.550208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Thu Jul 21 23:43:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:43:34.580920 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fce05089-0722-43b3-8c4a-8b50ea7f49ef tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:34.581553 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fce05089-0722-43b3-8c4a-8b50ea7f49ef tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:34.588361 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fce05089-0722-43b3-8c4a-8b50ea7f49ef tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:34.588804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fce05089-0722-43b3-8c4a-8b50ea7f49ef tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:34.589598 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fce05089-0722-43b3-8c4a-8b50ea7f49ef tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:34.590030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fce05089-0722-43b3-8c4a-8b50ea7f49ef tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:34.621223 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fce05089-0722-43b3-8c4a-8b50ea7f49ef tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:34.621669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fce05089-0722-43b3-8c4a-8b50ea7f49ef tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:34.622638 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-fce05089-0722-43b3-8c4a-8b50ea7f49ef tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lazy-loading 'fault' on Instance uuid 8d749247-571b-427e-83af-e7b9a7c3894d {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:43:34.666733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-fce05089-0722-43b3-8c4a-8b50ea7f49ef tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:34.674429 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fce05089-0722-43b3-8c4a-8b50ea7f49ef tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 200 len: 1331 microversion: 2.1 time: 0.097608 Jul 21 23:43:34.674990 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 334/636] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:34 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:34.796125 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0f6dc17e-bdf3-4355-b881-4de783179856 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:34.796774 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0f6dc17e-bdf3-4355-b881-4de783179856 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:34.803823 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0f6dc17e-bdf3-4355-b881-4de783179856 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:34.804200 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0f6dc17e-bdf3-4355-b881-4de783179856 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:34.804968 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0f6dc17e-bdf3-4355-b881-4de783179856 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:34.805435 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0f6dc17e-bdf3-4355-b881-4de783179856 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:34.936830 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0f6dc17e-bdf3-4355-b881-4de783179856 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:34.944488 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0f6dc17e-bdf3-4355-b881-4de783179856 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1688 microversion: 2.1 time: 0.152268 Jul 21 23:43:34.945474 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 303/637] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:34 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:35.692030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c96bf4da-2e28-48a5-ac76-effe20f72038 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:35.692642 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c96bf4da-2e28-48a5-ac76-effe20f72038 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:35.699019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c96bf4da-2e28-48a5-ac76-effe20f72038 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:35.699463 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c96bf4da-2e28-48a5-ac76-effe20f72038 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:35.700253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c96bf4da-2e28-48a5-ac76-effe20f72038 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:35.700662 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c96bf4da-2e28-48a5-ac76-effe20f72038 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:35.713716 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-c96bf4da-2e28-48a5-ac76-effe20f72038 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c96bf4da-2e28-48a5-ac76-effe20f72038 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d HTTP/1.1 Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:43:35.715339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:43:35.716748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '8d749247-571b-427e-83af-e7b9a7c3894d'} Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:43:35.717615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:43:35.718884 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:35.720082 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c96bf4da-2e28-48a5-ac76-effe20f72038 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:43:35.720082 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c96bf4da-2e28-48a5-ac76-effe20f72038 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 404 len: 111 microversion: 2.1 time: 0.028641 Jul 21 23:43:35.720082 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 335/638] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:35 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:43:35.725779 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5c84044c-fcc8-41e7-94a8-b0577250600a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '.version_select at 0x7f7d28981d30>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:35.734948 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:35.751525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5c84044c-fcc8-41e7-94a8-b0577250600a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734751469" status: 202 len: 0 microversion: 2.1 time: 0.029510 Jul 21 23:43:35.752186 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 304/639] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jul 21 23:43:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734751469 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:43:35.844239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-1a6cd529-a6b2-47bc-beed-dfbf74b07b18 req-d4cf713f-f5e2-4b2e-a440-bbbf19ce6cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b1ede1-a46a-454d-9b81-5b06de1124e9", "name": "network-vif-deleted", "tag": "35c14d66-0050-4ea8-b943-7e894d33c3e5"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:35.852858 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-1a6cd529-a6b2-47bc-beed-dfbf74b07b18 req-d4cf713f-f5e2-4b2e-a440-bbbf19ce6cb8 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:35.856250 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-1a6cd529-a6b2-47bc-beed-dfbf74b07b18 req-d4cf713f-f5e2-4b2e-a440-bbbf19ce6cb8 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:35.866758 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-1a6cd529-a6b2-47bc-beed-dfbf74b07b18 req-d4cf713f-f5e2-4b2e-a440-bbbf19ce6cb8 service nova] Creating event network-vif-deleted:35c14d66-0050-4ea8-b943-7e894d33c3e5 for instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 on hv-cinder-85070 Jul 21 23:43:35.874780 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-1a6cd529-a6b2-47bc-beed-dfbf74b07b18 req-d4cf713f-f5e2-4b2e-a440-bbbf19ce6cb8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033654 Jul 21 23:43:35.882172 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 336/640] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:35.967858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-da2b6b32-82ab-4b00-94b4-07e455278e87 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:35.968499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-da2b6b32-82ab-4b00-94b4-07e455278e87 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:35.985149 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-da2b6b32-82ab-4b00-94b4-07e455278e87 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:35.985638 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-da2b6b32-82ab-4b00-94b4-07e455278e87 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:35.986510 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-da2b6b32-82ab-4b00-94b4-07e455278e87 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:35.986946 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-da2b6b32-82ab-4b00-94b4-07e455278e87 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:36.061354 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-da2b6b32-82ab-4b00-94b4-07e455278e87 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:36.062581 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-da2b6b32-82ab-4b00-94b4-07e455278e87 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:36.063377 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.objects.instance [None req-da2b6b32-82ab-4b00-94b4-07e455278e87 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lazy-loading 'fault' on Instance uuid c9b1ede1-a46a-454d-9b81-5b06de1124e9 {{(pid=124387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:43:36.117644 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-da2b6b32-82ab-4b00-94b4-07e455278e87 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:36.131452 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-da2b6b32-82ab-4b00-94b4-07e455278e87 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 200 len: 1335 microversion: 2.1 time: 0.167392 Jul 21 23:43:36.141944 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 305/641] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:35 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 1335 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:36.505864 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6c0dd6d5-ce7f-4fa5-8e27-369f03014be4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: .version_select at 0x7f7d289f5ca0>, body: {"keypair": {"name": "tempest-keypair-777222530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB1fPhg11M8EDt5ZqTlqfMx+3XTSRgBdvTIjAjOkzflUVKAsht6th8+q9t5YbpULOJR0vx9wlV4CGOXNbSph2gOqUc0ymZm4g5qNVWKxanuOAVrdPVNUFcpRl6vKtY2cQ=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:36.519974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-6c0dd6d5-ce7f-4fa5-8e27-369f03014be4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for project fc4faed5bed7450da8122eeb77459f3a. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:43:36.523769 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-6c0dd6d5-ce7f-4fa5-8e27-369f03014be4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for user c44b88237c0f4ae7a31fbaaddbb2d427 and project fc4faed5bed7450da8122eeb77459f3a. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:43:36.546170 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6c0dd6d5-ce7f-4fa5-8e27-369f03014be4 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044492 Jul 21 23:43:36.546963 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 337/642] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 23:43:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:37.149485 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e21eec9c-2d60-458f-9980-be6bec372396 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:37.150324 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e21eec9c-2d60-458f-9980-be6bec372396 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c9b1ede1-a46a-454d-9b81-5b06de1124e9] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:37.160948 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e21eec9c-2d60-458f-9980-be6bec372396 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:37.161456 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e21eec9c-2d60-458f-9980-be6bec372396 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:37.162214 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e21eec9c-2d60-458f-9980-be6bec372396 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:37.162650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e21eec9c-2d60-458f-9980-be6bec372396 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:37.176939 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-e21eec9c-2d60-458f-9980-be6bec372396 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] HTTP exception thrown: Instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 could not be found. Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e21eec9c-2d60-458f-9980-be6bec372396 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Request method failure captured: Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 HTTP/1.1 Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOCyt5wNh_FEH36U-N0FQ8k_LyJAXtHZSu59k19ZVRspQaZUsZ2DfEOu4e8nxmFuU1dRPWLDo-7fs91ec5VLI_Y6xDsEXbioO6oijaevSZ7cyjgE4y4BNi72hFr6v9vZ7YV5VEpYuDxKOyg1RiPmTl3T5dBjovp0fu-vBs8xSx_6Gw Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 79b6d71ecbf94b7a81761727712881ea Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:43:37.178601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79b6d71ecbf94b7a81761727712881ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/79b6d71ecbf94b7a81761727712881ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_79b6d71ecbf94b7a81761727712881ea", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79b6d71ecbf94b7a81761727712881ea"}]}] Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 79b6d71ecbf94b7a81761727712881ea Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-ServerRescueNegativeTestJSON-777922945-project Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: b991805cfa834aab8dcab7d94d108ee2 Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777922945-project Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 could not be found. Jul 21 23:43:37.180239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': 'c9b1ede1-a46a-454d-9b81-5b06de1124e9'} Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 could not be found. Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:43:37.181050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 could not be found. Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 could not be found. Jul 21 23:43:37.182364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:37.183520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e21eec9c-2d60-458f-9980-be6bec372396 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Returning 404 to user: Instance c9b1ede1-a46a-454d-9b81-5b06de1124e9 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:43:37.183520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e21eec9c-2d60-458f-9980-be6bec372396 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9" status: 404 len: 111 microversion: 2.1 time: 0.034400 Jul 21 23:43:37.183520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 306/643] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:37 2022] GET /compute/v2.1/servers/c9b1ede1-a46a-454d-9b81-5b06de1124e9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:43:37.189335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-64d34068-e76a-4dad-ab1a-2bd7ba7e5551 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '.version_select at 0x7f7d28b82e50>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:37.207486 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-64d34068-e76a-4dad-ab1a-2bd7ba7e5551 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461769049" status: 202 len: 0 microversion: 2.1 time: 0.022506 Jul 21 23:43:37.208067 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 338/644] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jul 21 23:43:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461769049 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:43:38.093396 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-666236648", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db7b04fe-74b8-4a1d-b84d-14b166fb83d5"}], "security_groups": [{"name": "tempest-securitygroup--1574805973"}], "key_name": "tempest-keypair-777222530", "user_data": "}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:38.224876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] validate_networks() for [('db7b04fe-74b8-4a1d-b84d-14b166fb83d5', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:43:38.876199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:43:38.876633 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:43:38.877168 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:43:38.877609 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:43:38.878023 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:43:38.887053 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:38.887499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:38.888300 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:38.888734 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:38.905784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for project fc4faed5bed7450da8122eeb77459f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:43:38.909905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Getting quotas for user c44b88237c0f4ae7a31fbaaddbb2d427 and project fc4faed5bed7450da8122eeb77459f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:43:38.923469 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:43:38.924533 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:43:38.977941 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6bd9f0a7-a8e4-4a72-8111-a25d41615c9d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.888965 Jul 21 23:43:38.983918 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 307/645] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:43:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:43:38.989892 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3d90b75b-43e9-4d5f-bfe8-dfa8fb7c31f5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:38.990618 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3d90b75b-43e9-4d5f-bfe8-dfa8fb7c31f5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:39.064891 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3d90b75b-43e9-4d5f-bfe8-dfa8fb7c31f5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:39.072058 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3d90b75b-43e9-4d5f-bfe8-dfa8fb7c31f5 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1240 microversion: 2.1 time: 0.086998 Jul 21 23:43:39.072655 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 339/646] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:38 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:40.088781 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a642df4c-e56a-4bdf-9bee-fcac8d0f2b74 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:40.089432 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b7166f10-19d3-4d91-90ed-b1a24ac4560f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:40.089825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a642df4c-e56a-4bdf-9bee-fcac8d0f2b74 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:40.089930 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b7166f10-19d3-4d91-90ed-b1a24ac4560f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:40.097860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a642df4c-e56a-4bdf-9bee-fcac8d0f2b74 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:40.098404 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a642df4c-e56a-4bdf-9bee-fcac8d0f2b74 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:40.099041 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b7166f10-19d3-4d91-90ed-b1a24ac4560f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:40.099329 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a642df4c-e56a-4bdf-9bee-fcac8d0f2b74 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:40.099765 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b7166f10-19d3-4d91-90ed-b1a24ac4560f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:40.099883 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a642df4c-e56a-4bdf-9bee-fcac8d0f2b74 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:40.100671 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b7166f10-19d3-4d91-90ed-b1a24ac4560f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:40.101172 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b7166f10-19d3-4d91-90ed-b1a24ac4560f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:40.128248 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b7166f10-19d3-4d91-90ed-b1a24ac4560f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:43:40.174482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a642df4c-e56a-4bdf-9bee-fcac8d0f2b74 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:40.184549 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a642df4c-e56a-4bdf-9bee-fcac8d0f2b74 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1292 microversion: 2.1 time: 0.099493 Jul 21 23:43:40.189228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 340/647] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:40 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:43:40.223791 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b7166f10-19d3-4d91-90ed-b1a24ac4560f tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 204 len: 0 microversion: 2.1 time: 0.139041 Jul 21 23:43:40.224039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 308/648] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:43:40 2022] DELETE /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:43:40.233883 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0a764f76-3044-4eb3-a049-2c268ef73888 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:40.234758 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0a764f76-3044-4eb3-a049-2c268ef73888 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:40.241245 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a764f76-3044-4eb3-a049-2c268ef73888 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:40.241724 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a764f76-3044-4eb3-a049-2c268ef73888 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:40.242497 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a764f76-3044-4eb3-a049-2c268ef73888 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:40.242931 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a764f76-3044-4eb3-a049-2c268ef73888 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:40.377402 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0a764f76-3044-4eb3-a049-2c268ef73888 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:40.384880 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0a764f76-3044-4eb3-a049-2c268ef73888 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1509 microversion: 2.1 time: 0.156564 Jul 21 23:43:40.385497 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 341/649] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:40 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:41.204720 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c76ee7e2-8d88-4c4c-bcf4-3675b6ed9187 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:41.205446 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-c76ee7e2-8d88-4c4c-bcf4-3675b6ed9187 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:41.211884 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c76ee7e2-8d88-4c4c-bcf4-3675b6ed9187 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:41.212330 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c76ee7e2-8d88-4c4c-bcf4-3675b6ed9187 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:41.213089 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c76ee7e2-8d88-4c4c-bcf4-3675b6ed9187 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:41.213548 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c76ee7e2-8d88-4c4c-bcf4-3675b6ed9187 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:41.276777 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c76ee7e2-8d88-4c4c-bcf4-3675b6ed9187 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:41.285195 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-c76ee7e2-8d88-4c4c-bcf4-3675b6ed9187 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1310 microversion: 2.1 time: 0.085234 Jul 21 23:43:41.285760 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 309/650] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:41 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:41.402197 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1b1dc6d5-9ec2-42da-b6e8-9c17bceedf5a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:41.402705 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1b1dc6d5-9ec2-42da-b6e8-9c17bceedf5a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:41.409815 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b1dc6d5-9ec2-42da-b6e8-9c17bceedf5a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:41.410255 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b1dc6d5-9ec2-42da-b6e8-9c17bceedf5a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:41.411038 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b1dc6d5-9ec2-42da-b6e8-9c17bceedf5a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:41.411468 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1b1dc6d5-9ec2-42da-b6e8-9c17bceedf5a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:41.546991 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1b1dc6d5-9ec2-42da-b6e8-9c17bceedf5a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:41.554435 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1b1dc6d5-9ec2-42da-b6e8-9c17bceedf5a tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1509 microversion: 2.1 time: 0.156157 Jul 21 23:43:41.554998 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 342/651] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:41 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:42.302883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bbb9db18-44e7-4fed-b24d-f209d97a1ac2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:42.303495 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bbb9db18-44e7-4fed-b24d-f209d97a1ac2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:42.311035 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bbb9db18-44e7-4fed-b24d-f209d97a1ac2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:42.311682 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bbb9db18-44e7-4fed-b24d-f209d97a1ac2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:42.312749 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bbb9db18-44e7-4fed-b24d-f209d97a1ac2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:42.313473 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bbb9db18-44e7-4fed-b24d-f209d97a1ac2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:42.377271 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bbb9db18-44e7-4fed-b24d-f209d97a1ac2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:42.385340 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bbb9db18-44e7-4fed-b24d-f209d97a1ac2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1310 microversion: 2.1 time: 0.086508 Jul 21 23:43:42.385940 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 310/652] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:42 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:42.634968 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-70c64993-1bc2-456c-88ec-49014b21e691 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:42.634968 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-70c64993-1bc2-456c-88ec-49014b21e691 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:42.640252 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70c64993-1bc2-456c-88ec-49014b21e691 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:42.640704 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70c64993-1bc2-456c-88ec-49014b21e691 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:42.641575 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70c64993-1bc2-456c-88ec-49014b21e691 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:42.642010 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-70c64993-1bc2-456c-88ec-49014b21e691 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:42.777763 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-70c64993-1bc2-456c-88ec-49014b21e691 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:42.786560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-70c64993-1bc2-456c-88ec-49014b21e691 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1509 microversion: 2.1 time: 0.218644 Jul 21 23:43:42.787236 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 343/653] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:42 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:43.404018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e2a09666-cd5a-4279-8734-90ba941485c6 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:43.405364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e2a09666-cd5a-4279-8734-90ba941485c6 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:43.412993 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e2a09666-cd5a-4279-8734-90ba941485c6 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:43.413700 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e2a09666-cd5a-4279-8734-90ba941485c6 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:43.414948 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e2a09666-cd5a-4279-8734-90ba941485c6 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:43.415596 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e2a09666-cd5a-4279-8734-90ba941485c6 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:43.433224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-4c6c98c1-e573-48ad-b2f4-e32a931d9088 req-61fa848d-a8b8-4590-ba45-056dcd95a081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16c660c-f977-46c1-9b2a-c85d81c8368d", "name": "network-vif-deleted", "tag": "e5354cca-d4b3-4289-aaf0-fb839e6ccac2"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:43.451112 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4c6c98c1-e573-48ad-b2f4-e32a931d9088 req-61fa848d-a8b8-4590-ba45-056dcd95a081 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:43.451910 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4c6c98c1-e573-48ad-b2f4-e32a931d9088 req-61fa848d-a8b8-4590-ba45-056dcd95a081 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:43.474425 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-4c6c98c1-e573-48ad-b2f4-e32a931d9088 req-61fa848d-a8b8-4590-ba45-056dcd95a081 service nova] Creating event network-vif-deleted:e5354cca-d4b3-4289-aaf0-fb839e6ccac2 for instance c16c660c-f977-46c1-9b2a-c85d81c8368d on hv-cinder-85070 Jul 21 23:43:43.481165 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-4c6c98c1-e573-48ad-b2f4-e32a931d9088 req-61fa848d-a8b8-4590-ba45-056dcd95a081 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052580 Jul 21 23:43:43.482154 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 344/654] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:43.699483 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e2a09666-cd5a-4279-8734-90ba941485c6 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:43.707251 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e2a09666-cd5a-4279-8734-90ba941485c6 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1366 microversion: 2.1 time: 0.307559 Jul 21 23:43:43.707828 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 311/655] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:43 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:43.805166 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-36b1a574-c5cd-4224-9f76-7d96ba6abc45 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:43.806053 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-36b1a574-c5cd-4224-9f76-7d96ba6abc45 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:43.815814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36b1a574-c5cd-4224-9f76-7d96ba6abc45 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:43.816285 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36b1a574-c5cd-4224-9f76-7d96ba6abc45 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:43.817073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36b1a574-c5cd-4224-9f76-7d96ba6abc45 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:43.817550 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36b1a574-c5cd-4224-9f76-7d96ba6abc45 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:43.854312 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36b1a574-c5cd-4224-9f76-7d96ba6abc45 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:43.855177 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-36b1a574-c5cd-4224-9f76-7d96ba6abc45 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:43.855560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-36b1a574-c5cd-4224-9f76-7d96ba6abc45 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lazy-loading 'fault' on Instance uuid c16c660c-f977-46c1-9b2a-c85d81c8368d {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:43:43.901708 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-36b1a574-c5cd-4224-9f76-7d96ba6abc45 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:43.912906 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-36b1a574-c5cd-4224-9f76-7d96ba6abc45 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 200 len: 1312 microversion: 2.1 time: 0.111072 Jul 21 23:43:43.913920 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 345/656] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:43 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:44.723943 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8c406022-0e0c-4cd9-a676-9178a0fbad18 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:44.724547 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8c406022-0e0c-4cd9-a676-9178a0fbad18 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:44.731137 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8c406022-0e0c-4cd9-a676-9178a0fbad18 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:44.731479 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8c406022-0e0c-4cd9-a676-9178a0fbad18 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:44.732226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8c406022-0e0c-4cd9-a676-9178a0fbad18 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:44.732657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8c406022-0e0c-4cd9-a676-9178a0fbad18 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:44.859973 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-8c406022-0e0c-4cd9-a676-9178a0fbad18 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:44.867634 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8c406022-0e0c-4cd9-a676-9178a0fbad18 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1366 microversion: 2.1 time: 0.147495 Jul 21 23:43:44.868192 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 312/657] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:44 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:44.930495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-be1fd0a6-d6a7-494c-94e0-feea158a5c8e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:44.931102 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-be1fd0a6-d6a7-494c-94e0-feea158a5c8e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: c16c660c-f977-46c1-9b2a-c85d81c8368d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:44.938185 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be1fd0a6-d6a7-494c-94e0-feea158a5c8e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:44.938628 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be1fd0a6-d6a7-494c-94e0-feea158a5c8e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:44.939376 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be1fd0a6-d6a7-494c-94e0-feea158a5c8e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:44.939806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-be1fd0a6-d6a7-494c-94e0-feea158a5c8e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:44.952791 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-be1fd0a6-d6a7-494c-94e0-feea158a5c8e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] HTTP exception thrown: Instance c16c660c-f977-46c1-9b2a-c85d81c8368d could not be found. Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-be1fd0a6-d6a7-494c-94e0-feea158a5c8e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Request method failure captured: Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d HTTP/1.1 Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOCyt5wNh_FEH36U-N0FQ8k_LyJAXtHZSu59k19ZVRspQaZUsZ2DfEOu4e8nxmFuU1dRPWLDo-7fs91ec5VLI_Y6xDsEXbioO6oijaevSZ7cyjgE4y4BNi72hFr6v9vZ7YV5VEpYuDxKOyg1RiPmTl3T5dBjovp0fu-vBs8xSx_6Gw Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 79b6d71ecbf94b7a81761727712881ea Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:43:44.954416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79b6d71ecbf94b7a81761727712881ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/79b6d71ecbf94b7a81761727712881ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_79b6d71ecbf94b7a81761727712881ea", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79b6d71ecbf94b7a81761727712881ea"}]}] Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 79b6d71ecbf94b7a81761727712881ea Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-ServerRescueNegativeTestJSON-777922945-project Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: b991805cfa834aab8dcab7d94d108ee2 Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777922945-project Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance c16c660c-f977-46c1-9b2a-c85d81c8368d could not be found. Jul 21 23:43:44.955873 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'c16c660c-f977-46c1-9b2a-c85d81c8368d'} Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c16c660c-f977-46c1-9b2a-c85d81c8368d could not be found. Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:43:44.956733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c16c660c-f977-46c1-9b2a-c85d81c8368d could not be found. Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c16c660c-f977-46c1-9b2a-c85d81c8368d could not be found. Jul 21 23:43:44.958313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:44.959718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-be1fd0a6-d6a7-494c-94e0-feea158a5c8e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Returning 404 to user: Instance c16c660c-f977-46c1-9b2a-c85d81c8368d could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:43:44.959718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-be1fd0a6-d6a7-494c-94e0-feea158a5c8e tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d" status: 404 len: 111 microversion: 2.1 time: 0.029102 Jul 21 23:43:44.959718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 346/658] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:44 2022] GET /compute/v2.1/servers/c16c660c-f977-46c1-9b2a-c85d81c8368d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:43:44.964140 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-577059ea-e410-4844-bdd5-3f8da9e22699 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:44.964625 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-577059ea-e410-4844-bdd5-3f8da9e22699 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:44.970567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-577059ea-e410-4844-bdd5-3f8da9e22699 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:44.971005 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-577059ea-e410-4844-bdd5-3f8da9e22699 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:44.971756 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-577059ea-e410-4844-bdd5-3f8da9e22699 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:44.972186 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-577059ea-e410-4844-bdd5-3f8da9e22699 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:44.997100 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-577059ea-e410-4844-bdd5-3f8da9e22699 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:43:45.068608 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-577059ea-e410-4844-bdd5-3f8da9e22699 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 204 len: 0 microversion: 2.1 time: 0.107941 Jul 21 23:43:45.069176 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 313/659] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:43:44 2022] DELETE /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:43:45.077332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3235f714-fea8-41e8-a7d4-8f9cf5e89651 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:45.077943 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3235f714-fea8-41e8-a7d4-8f9cf5e89651 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:45.084016 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3235f714-fea8-41e8-a7d4-8f9cf5e89651 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:45.084468 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3235f714-fea8-41e8-a7d4-8f9cf5e89651 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:45.085636 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3235f714-fea8-41e8-a7d4-8f9cf5e89651 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:45.085851 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3235f714-fea8-41e8-a7d4-8f9cf5e89651 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:45.219389 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3235f714-fea8-41e8-a7d4-8f9cf5e89651 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:45.226814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3235f714-fea8-41e8-a7d4-8f9cf5e89651 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.153494 Jul 21 23:43:45.227367 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 347/660] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:45 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:45.517541 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-41df3dfa-ce3a-4e2e-8b67-e5147f0a336e req-272b3538-783f-42e9-8447-3da620d1b977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57dcf8f0-0e4e-4842-863d-bc83a31fa4f0", "tag": "cd4fc162-7a71-42e5-b8e5-4f425626f386"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:45.525574 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-41df3dfa-ce3a-4e2e-8b67-e5147f0a336e req-272b3538-783f-42e9-8447-3da620d1b977 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:45.526016 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-41df3dfa-ce3a-4e2e-8b67-e5147f0a336e req-272b3538-783f-42e9-8447-3da620d1b977 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:45.538647 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-41df3dfa-ce3a-4e2e-8b67-e5147f0a336e req-272b3538-783f-42e9-8447-3da620d1b977 service nova] Creating event network-changed:cd4fc162-7a71-42e5-b8e5-4f425626f386 for instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 on hv-cinder-85070 Jul 21 23:43:45.543292 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-41df3dfa-ce3a-4e2e-8b67-e5147f0a336e req-272b3538-783f-42e9-8447-3da620d1b977 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030110 Jul 21 23:43:45.543887 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 314/661] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:45.884212 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9be8bb1e-35a7-4e72-96e4-0135e9112f6a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:45.884948 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9be8bb1e-35a7-4e72-96e4-0135e9112f6a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:45.891413 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9be8bb1e-35a7-4e72-96e4-0135e9112f6a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:45.891861 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9be8bb1e-35a7-4e72-96e4-0135e9112f6a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:45.892690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9be8bb1e-35a7-4e72-96e4-0135e9112f6a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:45.893125 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9be8bb1e-35a7-4e72-96e4-0135e9112f6a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:46.026198 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9be8bb1e-35a7-4e72-96e4-0135e9112f6a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:46.034049 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9be8bb1e-35a7-4e72-96e4-0135e9112f6a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1366 microversion: 2.1 time: 0.153867 Jul 21 23:43:46.034634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 348/662] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:45 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:46.244745 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-033c1fa9-8330-421e-a91d-1d6b5e82e9f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:46.245474 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-033c1fa9-8330-421e-a91d-1d6b5e82e9f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:46.251829 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-033c1fa9-8330-421e-a91d-1d6b5e82e9f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:46.252560 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-033c1fa9-8330-421e-a91d-1d6b5e82e9f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:46.253502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-033c1fa9-8330-421e-a91d-1d6b5e82e9f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:46.253938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-033c1fa9-8330-421e-a91d-1d6b5e82e9f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:46.382649 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-033c1fa9-8330-421e-a91d-1d6b5e82e9f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:46.390664 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-033c1fa9-8330-421e-a91d-1d6b5e82e9f4 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.150929 Jul 21 23:43:46.391219 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 315/663] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:46 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:47.099911 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-acaf94d5-5a9a-472a-8d1c-2bd786559a52 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:47.100532 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-acaf94d5-5a9a-472a-8d1c-2bd786559a52 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:47.106661 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acaf94d5-5a9a-472a-8d1c-2bd786559a52 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:47.107113 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acaf94d5-5a9a-472a-8d1c-2bd786559a52 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:47.107883 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acaf94d5-5a9a-472a-8d1c-2bd786559a52 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:47.108322 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-acaf94d5-5a9a-472a-8d1c-2bd786559a52 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:47.235856 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-acaf94d5-5a9a-472a-8d1c-2bd786559a52 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:47.243617 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-acaf94d5-5a9a-472a-8d1c-2bd786559a52 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1366 microversion: 2.1 time: 0.197380 Jul 21 23:43:47.244269 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 349/664] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:47 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:47.408387 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c1a6afc6-4162-48ad-b0e8-1cb25750c5cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:47.408926 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-c1a6afc6-4162-48ad-b0e8-1cb25750c5cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:47.415511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c1a6afc6-4162-48ad-b0e8-1cb25750c5cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:47.415962 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c1a6afc6-4162-48ad-b0e8-1cb25750c5cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:47.416729 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c1a6afc6-4162-48ad-b0e8-1cb25750c5cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:47.417174 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c1a6afc6-4162-48ad-b0e8-1cb25750c5cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:47.548333 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c1a6afc6-4162-48ad-b0e8-1cb25750c5cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:47.555723 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-c1a6afc6-4162-48ad-b0e8-1cb25750c5cf tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.151476 Jul 21 23:43:47.556284 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 316/665] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:47 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:47.896874 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-8e71bcac-e68c-4399-bb3d-41538cb69d86 req-1fe406bd-fc60-4ea8-812a-ed79575df29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57dcf8f0-0e4e-4842-863d-bc83a31fa4f0", "name": "network-vif-plugged", "status": "completed", "tag": "cd4fc162-7a71-42e5-b8e5-4f425626f386"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:47.905331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-8e71bcac-e68c-4399-bb3d-41538cb69d86 req-1fe406bd-fc60-4ea8-812a-ed79575df29e service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:47.905817 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-8e71bcac-e68c-4399-bb3d-41538cb69d86 req-1fe406bd-fc60-4ea8-812a-ed79575df29e service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:47.916880 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-8e71bcac-e68c-4399-bb3d-41538cb69d86 req-1fe406bd-fc60-4ea8-812a-ed79575df29e service nova] Creating event network-vif-plugged:cd4fc162-7a71-42e5-b8e5-4f425626f386 for instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 on hv-cinder-85070 Jul 21 23:43:47.922310 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-8e71bcac-e68c-4399-bb3d-41538cb69d86 req-1fe406bd-fc60-4ea8-812a-ed79575df29e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029637 Jul 21 23:43:47.922900 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 350/666] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:48.260642 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-69cfa1b3-9130-451a-95dd-589f1e475656 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:48.261289 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-69cfa1b3-9130-451a-95dd-589f1e475656 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:48.267872 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-69cfa1b3-9130-451a-95dd-589f1e475656 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:48.268315 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-69cfa1b3-9130-451a-95dd-589f1e475656 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:48.269069 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-69cfa1b3-9130-451a-95dd-589f1e475656 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:48.269526 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-69cfa1b3-9130-451a-95dd-589f1e475656 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:48.386147 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-06bb3731-8448-44bc-90a4-9b3da7b4ff55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:48.387249 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-06bb3731-8448-44bc-90a4-9b3da7b4ff55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:48.394381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-06bb3731-8448-44bc-90a4-9b3da7b4ff55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:48.394833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-06bb3731-8448-44bc-90a4-9b3da7b4ff55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:48.395601 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-06bb3731-8448-44bc-90a4-9b3da7b4ff55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:48.396037 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-06bb3731-8448-44bc-90a4-9b3da7b4ff55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:48.401489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-69cfa1b3-9130-451a-95dd-589f1e475656 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:48.409923 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-69cfa1b3-9130-451a-95dd-589f1e475656 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1366 microversion: 2.1 time: 0.153104 Jul 21 23:43:48.410883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 317/667] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:48 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:48.425855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-06bb3731-8448-44bc-90a4-9b3da7b4ff55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044522 Jul 21 23:43:48.426418 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 351/668] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:43:48 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 23:43:48.481500 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-fa9a4d11-88c0-4b5e-8359-b91cfe36e810 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:48.481999 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-fa9a4d11-88c0-4b5e-8359-b91cfe36e810 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:48.488982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fa9a4d11-88c0-4b5e-8359-b91cfe36e810 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:48.489461 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fa9a4d11-88c0-4b5e-8359-b91cfe36e810 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:48.490222 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fa9a4d11-88c0-4b5e-8359-b91cfe36e810 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:48.490656 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fa9a4d11-88c0-4b5e-8359-b91cfe36e810 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:48.509363 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:48.517672 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-fa9a4d11-88c0-4b5e-8359-b91cfe36e810 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:43:48.573323 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-503b8e53-47ee-4604-b239-6eda8ebe3343 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:48.573964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-503b8e53-47ee-4604-b239-6eda8ebe3343 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:48.580985 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-503b8e53-47ee-4604-b239-6eda8ebe3343 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:48.581725 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-503b8e53-47ee-4604-b239-6eda8ebe3343 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:48.582610 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-503b8e53-47ee-4604-b239-6eda8ebe3343 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:48.583153 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-503b8e53-47ee-4604-b239-6eda8ebe3343 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:48.601338 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-fa9a4d11-88c0-4b5e-8359-b91cfe36e810 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "DELETE /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 204 len: 0 microversion: 2.1 time: 0.122927 Jul 21 23:43:48.606876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 318/669] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:43:48 2022] DELETE /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:43:48.614834 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-483dcd8f-c6bf-46cf-81ab-8b695ffc93a4 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:48.615537 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-483dcd8f-c6bf-46cf-81ab-8b695ffc93a4 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:48.623009 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-483dcd8f-c6bf-46cf-81ab-8b695ffc93a4 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:48.624299 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-483dcd8f-c6bf-46cf-81ab-8b695ffc93a4 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:48.626012 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-483dcd8f-c6bf-46cf-81ab-8b695ffc93a4 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:48.626012 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-483dcd8f-c6bf-46cf-81ab-8b695ffc93a4 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:48.729461 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-503b8e53-47ee-4604-b239-6eda8ebe3343 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:48.738903 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-503b8e53-47ee-4604-b239-6eda8ebe3343 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.169387 Jul 21 23:43:48.739491 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 352/670] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:48 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:48.763585 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-483dcd8f-c6bf-46cf-81ab-8b695ffc93a4 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:48.771222 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-483dcd8f-c6bf-46cf-81ab-8b695ffc93a4 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1675 microversion: 2.1 time: 0.161663 Jul 21 23:43:48.771790 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 319/671] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:48 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:49.033950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-15947df7-cd96-41d6-a643-129d3e4ad3ed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1726777768"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:49.034488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-15947df7-cd96-41d6-a643-129d3e4ad3ed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:49.040485 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-15947df7-cd96-41d6-a643-129d3e4ad3ed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:49.040935 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-15947df7-cd96-41d6-a643-129d3e4ad3ed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:49.041729 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-15947df7-cd96-41d6-a643-129d3e4ad3ed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:49.042164 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-15947df7-cd96-41d6-a643-129d3e4ad3ed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:49.068787 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:49.169058 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.network.security_group_api [None req-15947df7-cd96-41d6-a643-129d3e4ad3ed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Removing security group 5d1c61dd-f060-46d3-a82f-350a6ea95119 from port 3d912156-66c3-4060-a4b0-45f5c1b2da29 Jul 21 23:43:49.426881 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9d8b8180-f326-45cc-b951-a15cfda06f54 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:49.427502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9d8b8180-f326-45cc-b951-a15cfda06f54 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:49.429454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:49.430263 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=6 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:49.437071 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9d8b8180-f326-45cc-b951-a15cfda06f54 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:49.437573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9d8b8180-f326-45cc-b951-a15cfda06f54 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:49.438350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9d8b8180-f326-45cc-b951-a15cfda06f54 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:49.438788 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9d8b8180-f326-45cc-b951-a15cfda06f54 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:49.519266 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-15947df7-cd96-41d6-a643-129d3e4ad3ed tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "POST /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/action" status: 202 len: 0 microversion: 2.1 time: 0.488619 Jul 21 23:43:49.521955 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 353/672] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:43:49 2022] POST /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:43:49.536059 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-02bf8640-ea43-4467-9696-cbc3e238ac67 req-0ae6230c-e05f-495b-96b4-ea116c38d7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5fa3e4-c19a-40ef-8cec-92cd819d132f", "tag": "3d912156-66c3-4060-a4b0-45f5c1b2da29"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:49.550144 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-02bf8640-ea43-4467-9696-cbc3e238ac67 req-0ae6230c-e05f-495b-96b4-ea116c38d7e2 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:49.551323 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-02bf8640-ea43-4467-9696-cbc3e238ac67 req-0ae6230c-e05f-495b-96b4-ea116c38d7e2 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:49.588103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-02bf8640-ea43-4467-9696-cbc3e238ac67 req-0ae6230c-e05f-495b-96b4-ea116c38d7e2 service nova] Creating event network-changed:3d912156-66c3-4060-a4b0-45f5c1b2da29 for instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f on hv-cinder-85070 Jul 21 23:43:49.595748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-02bf8640-ea43-4467-9696-cbc3e238ac67 req-0ae6230c-e05f-495b-96b4-ea116c38d7e2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064529 Jul 21 23:43:49.596797 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 354/673] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:49.664521 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9d8b8180-f326-45cc-b951-a15cfda06f54 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:49.675038 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9d8b8180-f326-45cc-b951-a15cfda06f54 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1366 microversion: 2.1 time: 0.251953 Jul 21 23:43:49.684833 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 320/674] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:49 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:43:49.758177 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-815aa6e5-58d9-406d-89cf-c05dc293b25b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:49.759124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-815aa6e5-58d9-406d-89cf-c05dc293b25b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:49.766557 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-815aa6e5-58d9-406d-89cf-c05dc293b25b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:49.767016 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-815aa6e5-58d9-406d-89cf-c05dc293b25b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:49.767797 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-815aa6e5-58d9-406d-89cf-c05dc293b25b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:49.768230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-815aa6e5-58d9-406d-89cf-c05dc293b25b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:49.772697 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:49.789814 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-805ff07e-1858-428d-aead-a90bb49666c6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:49.790505 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-805ff07e-1858-428d-aead-a90bb49666c6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:49.799502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-805ff07e-1858-428d-aead-a90bb49666c6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:49.809766 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-805ff07e-1858-428d-aead-a90bb49666c6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:49.810570 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-805ff07e-1858-428d-aead-a90bb49666c6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:49.811221 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-805ff07e-1858-428d-aead-a90bb49666c6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:49.969742 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-805ff07e-1858-428d-aead-a90bb49666c6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:49.977241 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-805ff07e-1858-428d-aead-a90bb49666c6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1675 microversion: 2.1 time: 0.192152 Jul 21 23:43:49.977817 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 321/675] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:49 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:50.014444 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-815aa6e5-58d9-406d-89cf-c05dc293b25b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:50.022132 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-815aa6e5-58d9-406d-89cf-c05dc293b25b tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.269046 Jul 21 23:43:50.022729 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 355/676] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:49 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:43:50.693230 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ccd6acad-c097-4b9c-b80f-a3ecae159414 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:50.694563 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ccd6acad-c097-4b9c-b80f-a3ecae159414 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:50.701716 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ccd6acad-c097-4b9c-b80f-a3ecae159414 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:50.702630 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ccd6acad-c097-4b9c-b80f-a3ecae159414 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:50.703589 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ccd6acad-c097-4b9c-b80f-a3ecae159414 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:50.704260 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ccd6acad-c097-4b9c-b80f-a3ecae159414 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:50.997017 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-98f2738a-918a-4d51-a6a5-98a333608d2c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:50.997659 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-98f2738a-918a-4d51-a6a5-98a333608d2c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:51.009222 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-98f2738a-918a-4d51-a6a5-98a333608d2c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:51.010827 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-98f2738a-918a-4d51-a6a5-98a333608d2c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:51.010827 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-98f2738a-918a-4d51-a6a5-98a333608d2c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:51.011317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-98f2738a-918a-4d51-a6a5-98a333608d2c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:51.156382 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-98f2738a-918a-4d51-a6a5-98a333608d2c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:51.164332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-98f2738a-918a-4d51-a6a5-98a333608d2c tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1675 microversion: 2.1 time: 0.171083 Jul 21 23:43:51.165101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 356/677] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:50 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:51.169712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e49054aa-be92-4bfc-b7ca-34ef9dcb6503 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:51.170256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e49054aa-be92-4bfc-b7ca-34ef9dcb6503 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:51.176848 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e49054aa-be92-4bfc-b7ca-34ef9dcb6503 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:51.177443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e49054aa-be92-4bfc-b7ca-34ef9dcb6503 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:51.178480 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e49054aa-be92-4bfc-b7ca-34ef9dcb6503 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:51.178648 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e49054aa-be92-4bfc-b7ca-34ef9dcb6503 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:51.266177 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-e49054aa-be92-4bfc-b7ca-34ef9dcb6503 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lazy-loading 'services' on Instance uuid 2e5fa3e4-c19a-40ef-8cec-92cd819d132f {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:43:51.337250 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ccd6acad-c097-4b9c-b80f-a3ecae159414 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:51.346172 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ccd6acad-c097-4b9c-b80f-a3ecae159414 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1366 microversion: 2.1 time: 0.656782 Jul 21 23:43:51.347341 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 322/678] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:50 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1366 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:51.352184 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3fa0cf1d-6037-4210-9201-d8ad1eee00cc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:51.352942 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3fa0cf1d-6037-4210-9201-d8ad1eee00cc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:51.359529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e49054aa-be92-4bfc-b7ca-34ef9dcb6503 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments/02e9525f-f62a-4596-8ca5-94218027e152" status: 202 len: 0 microversion: 2.1 time: 0.193372 Jul 21 23:43:51.360260 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 357/679] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:43:51 2022] DELETE /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments/02e9525f-f62a-4596-8ca5-94218027e152 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:43:51.360718 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3fa0cf1d-6037-4210-9201-d8ad1eee00cc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:51.361351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3fa0cf1d-6037-4210-9201-d8ad1eee00cc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:51.362431 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3fa0cf1d-6037-4210-9201-d8ad1eee00cc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:51.363004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3fa0cf1d-6037-4210-9201-d8ad1eee00cc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:51.369313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1117e25c-d570-41d0-9ecd-e6958b1e01a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:51.370504 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1117e25c-d570-41d0-9ecd-e6958b1e01a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:51.377977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1117e25c-d570-41d0-9ecd-e6958b1e01a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:51.378558 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1117e25c-d570-41d0-9ecd-e6958b1e01a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:51.380145 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1117e25c-d570-41d0-9ecd-e6958b1e01a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:51.380678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1117e25c-d570-41d0-9ecd-e6958b1e01a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:51.414665 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1117e25c-d570-41d0-9ecd-e6958b1e01a6 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049721 Jul 21 23:43:51.415542 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 358/680] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:43:51 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:51.612760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-26121634-2e8e-42e0-bbb1-80f88f632891 req-c195cbc6-b1ca-4095-94b5-4a94f9c24f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5fa3e4-c19a-40ef-8cec-92cd819d132f", "tag": "3d912156-66c3-4060-a4b0-45f5c1b2da29"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:51.621689 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-26121634-2e8e-42e0-bbb1-80f88f632891 req-c195cbc6-b1ca-4095-94b5-4a94f9c24f0b service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:51.622415 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-26121634-2e8e-42e0-bbb1-80f88f632891 req-c195cbc6-b1ca-4095-94b5-4a94f9c24f0b service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:51.634661 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-26121634-2e8e-42e0-bbb1-80f88f632891 req-c195cbc6-b1ca-4095-94b5-4a94f9c24f0b service nova] Creating event network-changed:3d912156-66c3-4060-a4b0-45f5c1b2da29 for instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f on hv-cinder-85070 Jul 21 23:43:51.640342 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-26121634-2e8e-42e0-bbb1-80f88f632891 req-c195cbc6-b1ca-4095-94b5-4a94f9c24f0b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032216 Jul 21 23:43:51.641273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 359/681] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:43:51.825136 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3fa0cf1d-6037-4210-9201-d8ad1eee00cc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:51.833847 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3fa0cf1d-6037-4210-9201-d8ad1eee00cc tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1520 microversion: 2.1 time: 0.485077 Jul 21 23:43:51.834468 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 323/682] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:51 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1520 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:52.182522 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c47e18e3-64dd-4695-8171-2ea51a1f1450 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:52.183462 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c47e18e3-64dd-4695-8171-2ea51a1f1450 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:52.191003 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c47e18e3-64dd-4695-8171-2ea51a1f1450 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.191460 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c47e18e3-64dd-4695-8171-2ea51a1f1450 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.192441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c47e18e3-64dd-4695-8171-2ea51a1f1450 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.192886 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c47e18e3-64dd-4695-8171-2ea51a1f1450 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.238994 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-8cf9e18d-e890-44b5-ae36-02fe9d96eb43 req-67a32f3b-e311-4610-86d5-a2b79556d09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af6350f-5066-435f-bf01-5541dd1d3b18", "name": "network-vif-deleted", "tag": "365fc751-fe38-4f1c-aa15-d43a2299f5d0"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:52.259201 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-8cf9e18d-e890-44b5-ae36-02fe9d96eb43 req-67a32f3b-e311-4610-86d5-a2b79556d09d service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.259651 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-8cf9e18d-e890-44b5-ae36-02fe9d96eb43 req-67a32f3b-e311-4610-86d5-a2b79556d09d service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.285484 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-8cf9e18d-e890-44b5-ae36-02fe9d96eb43 req-67a32f3b-e311-4610-86d5-a2b79556d09d service nova] Creating event network-vif-deleted:365fc751-fe38-4f1c-aa15-d43a2299f5d0 for instance 7af6350f-5066-435f-bf01-5541dd1d3b18 on hv-cinder-85070 Jul 21 23:43:52.291300 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-8cf9e18d-e890-44b5-ae36-02fe9d96eb43 req-67a32f3b-e311-4610-86d5-a2b79556d09d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055783 Jul 21 23:43:52.292135 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 324/683] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:52.369865 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c47e18e3-64dd-4695-8171-2ea51a1f1450 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:52.371898 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6d2f602a-6869-4965-9f4d-ce6cdbd5374a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:52.372820 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6d2f602a-6869-4965-9f4d-ce6cdbd5374a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:52.382122 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c47e18e3-64dd-4695-8171-2ea51a1f1450 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1675 microversion: 2.1 time: 0.203823 Jul 21 23:43:52.383698 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 360/684] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:52 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:52.384737 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d2f602a-6869-4965-9f4d-ce6cdbd5374a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.385419 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d2f602a-6869-4965-9f4d-ce6cdbd5374a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.386733 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d2f602a-6869-4965-9f4d-ce6cdbd5374a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.388398 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6d2f602a-6869-4965-9f4d-ce6cdbd5374a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.439152 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e96c6549-2876-4786-bb7b-52b16d77428d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:52.440103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e96c6549-2876-4786-bb7b-52b16d77428d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:52.447476 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e96c6549-2876-4786-bb7b-52b16d77428d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.448534 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e96c6549-2876-4786-bb7b-52b16d77428d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.450206 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e96c6549-2876-4786-bb7b-52b16d77428d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.451935 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e96c6549-2876-4786-bb7b-52b16d77428d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.506947 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e96c6549-2876-4786-bb7b-52b16d77428d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082604 Jul 21 23:43:52.507943 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 361/685] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:43:52 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:43:52.714746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6d2f602a-6869-4965-9f4d-ce6cdbd5374a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:52.724788 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6d2f602a-6869-4965-9f4d-ce6cdbd5374a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1557 microversion: 2.1 time: 0.363908 Jul 21 23:43:52.725693 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 325/686] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:52 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1557 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:52.742818 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-10cab15d-e377-44e9-b86a-757a69d38e99 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:52.743315 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-10cab15d-e377-44e9-b86a-757a69d38e99 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:52.745323 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:52.752149 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-10cab15d-e377-44e9-b86a-757a69d38e99 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.752790 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-10cab15d-e377-44e9-b86a-757a69d38e99 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.753868 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-10cab15d-e377-44e9-b86a-757a69d38e99 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.754544 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-10cab15d-e377-44e9-b86a-757a69d38e99 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.853667 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2a2b199e-ccde-4369-95e8-6fa4d938376d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:52.854286 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-10cab15d-e377-44e9-b86a-757a69d38e99 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114975 Jul 21 23:43:52.855707 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2a2b199e-ccde-4369-95e8-6fa4d938376d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:52.861890 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 362/687] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 23:43:52 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:43:52.870159 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2a2b199e-ccde-4369-95e8-6fa4d938376d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.871393 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2a2b199e-ccde-4369-95e8-6fa4d938376d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.877273 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2a2b199e-ccde-4369-95e8-6fa4d938376d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.877936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2a2b199e-ccde-4369-95e8-6fa4d938376d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.953979 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2a2b199e-ccde-4369-95e8-6fa4d938376d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:52.954698 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2a2b199e-ccde-4369-95e8-6fa4d938376d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:52.955371 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.objects.instance [None req-2a2b199e-ccde-4369-95e8-6fa4d938376d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lazy-loading 'fault' on Instance uuid 7af6350f-5066-435f-bf01-5541dd1d3b18 {{(pid=124387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:43:53.144171 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2a2b199e-ccde-4369-95e8-6fa4d938376d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b991805cfa834aab8dcab7d94d108ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b6d71ecbf94b7a81761727712881ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:53.151639 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2a2b199e-ccde-4369-95e8-6fa4d938376d tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 200 len: 1310 microversion: 2.1 time: 0.304071 Jul 21 23:43:53.152410 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 326/688] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:52 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 1310 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:53.401587 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e237c3a3-c7cb-4288-9ece-c4c09a01bd55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:53.402956 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e237c3a3-c7cb-4288-9ece-c4c09a01bd55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:53.416877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e237c3a3-c7cb-4288-9ece-c4c09a01bd55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:53.417643 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e237c3a3-c7cb-4288-9ece-c4c09a01bd55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:53.420842 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e237c3a3-c7cb-4288-9ece-c4c09a01bd55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:53.421484 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e237c3a3-c7cb-4288-9ece-c4c09a01bd55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:53.520868 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-290ebf1e-7709-4517-ac07-ddaea34d388d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:53.522321 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-290ebf1e-7709-4517-ac07-ddaea34d388d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:53.539427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-290ebf1e-7709-4517-ac07-ddaea34d388d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:53.539686 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e237c3a3-c7cb-4288-9ece-c4c09a01bd55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:53.540109 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-290ebf1e-7709-4517-ac07-ddaea34d388d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:53.540898 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-290ebf1e-7709-4517-ac07-ddaea34d388d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:53.541364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-290ebf1e-7709-4517-ac07-ddaea34d388d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:53.550393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e237c3a3-c7cb-4288-9ece-c4c09a01bd55 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 200 len: 1323 microversion: 2.1 time: 0.152500 Jul 21 23:43:53.551823 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 363/689] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:53 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:53.591606 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-290ebf1e-7709-4517-ac07-ddaea34d388d tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075683 Jul 21 23:43:53.592466 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 327/690] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:43:53 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 23:43:53.602941 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-07e7438e-432d-4b44-96eb-93ae75633f59 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:53.603438 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-07e7438e-432d-4b44-96eb-93ae75633f59 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:53.610045 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07e7438e-432d-4b44-96eb-93ae75633f59 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:53.610499 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07e7438e-432d-4b44-96eb-93ae75633f59 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:53.611269 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07e7438e-432d-4b44-96eb-93ae75633f59 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:53.611704 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-07e7438e-432d-4b44-96eb-93ae75633f59 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:53.690621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-07e7438e-432d-4b44-96eb-93ae75633f59 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] HTTP exception thrown: Instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f is not attached to volume 02e9525f-f62a-4596-8ca5-94218027e152 Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-07e7438e-432d-4b44-96eb-93ae75633f59 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Request method failure captured: Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments/02e9525f-f62a-4596-8ca5-94218027e152 HTTP/1.1 Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2ePpb2H5q0MTYWMJVXPtsVKGUc8jVkM8vPNETRK8j3kBz23Y-8qjMal4HJ2fIiiI3t8_FMfgxsmQmiCdKPmxCz9hafgYzfDLWOFb743ZrxrE6KvWAJPsepv3RXBq6aCvEQ76GClzkkulw-1_lNjr7cCa_YKySwIKDqipMjvo8hSDPgA Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 235634c0fcf14ebeab084cfca36d394b Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-TestMinimumBasicScenario-1318923754 Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:43:53.693006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:43:53.694447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/235634c0fcf14ebeab084cfca36d394b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/235634c0fcf14ebeab084cfca36d394b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_235634c0fcf14ebeab084cfca36d394b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/235634c0fcf14ebeab084cfca36d394b"}]}] Jul 21 23:43:53.694447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-TestMinimumBasicScenario-1318923754 Jul 21 23:43:53.694447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 235634c0fcf14ebeab084cfca36d394b Jul 21 23:43:53.694447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1318923754 Jul 21 23:43:53.694447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-TestMinimumBasicScenario-1318923754-project Jul 21 23:43:53.694447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:43:53.694447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:43:53.694447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 33ffdc9526374a07b696f5cc59b22ef7 Jul 21 23:43:53.694447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-TestMinimumBasicScenario-1318923754-project Jul 21 23:43:53.694447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:43:53.694447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f is not attached to volume 02e9525f-f62a-4596-8ca5-94218027e152 Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'server_id': '2e5fa3e4-c19a-40ef-8cec-92cd819d132f', 'id': '02e9525f-f62a-4596-8ca5-94218027e152'} Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 02e9525f-f62a-4596-8ca5-94218027e152. Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:43:53.695141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f is not attached to volume 02e9525f-f62a-4596-8ca5-94218027e152 Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f is not attached to volume 02e9525f-f62a-4596-8ca5-94218027e152 Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:53.696279 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-07e7438e-432d-4b44-96eb-93ae75633f59 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Returning 404 to user: Instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f is not attached to volume 02e9525f-f62a-4596-8ca5-94218027e152 {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:43:53.698801 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-07e7438e-432d-4b44-96eb-93ae75633f59 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments/02e9525f-f62a-4596-8ca5-94218027e152" status: 404 len: 154 microversion: 2.1 time: 0.095866 Jul 21 23:43:53.698801 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 364/691] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:43:53 2022] DELETE /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f/os-volume_attachments/02e9525f-f62a-4596-8ca5-94218027e152 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:43:54.062152 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-08ce4217-7b35-425a-9bea-bf50b3f36617 req-6f6549b2-c559-47ce-8293-19d6be78f18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57dcf8f0-0e4e-4842-863d-bc83a31fa4f0", "tag": "cd4fc162-7a71-42e5-b8e5-4f425626f386"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:54.072762 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-08ce4217-7b35-425a-9bea-bf50b3f36617 req-6f6549b2-c559-47ce-8293-19d6be78f18b service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:54.073421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-08ce4217-7b35-425a-9bea-bf50b3f36617 req-6f6549b2-c559-47ce-8293-19d6be78f18b service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:54.088223 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-08ce4217-7b35-425a-9bea-bf50b3f36617 req-6f6549b2-c559-47ce-8293-19d6be78f18b service nova] Creating event network-changed:cd4fc162-7a71-42e5-b8e5-4f425626f386 for instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 on hv-cinder-85070 Jul 21 23:43:54.105146 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-08ce4217-7b35-425a-9bea-bf50b3f36617 req-6f6549b2-c559-47ce-8293-19d6be78f18b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047500 Jul 21 23:43:54.109526 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 328/692] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:54.169388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-114927b9-3301-4f87-b8e9-8dc586bcaaf9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:54.170733 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-114927b9-3301-4f87-b8e9-8dc586bcaaf9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] [instance: 7af6350f-5066-435f-bf01-5541dd1d3b18] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:54.178791 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-114927b9-3301-4f87-b8e9-8dc586bcaaf9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:54.179986 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-114927b9-3301-4f87-b8e9-8dc586bcaaf9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:54.180925 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-114927b9-3301-4f87-b8e9-8dc586bcaaf9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:54.181526 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-114927b9-3301-4f87-b8e9-8dc586bcaaf9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:54.202140 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-114927b9-3301-4f87-b8e9-8dc586bcaaf9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] HTTP exception thrown: Instance 7af6350f-5066-435f-bf01-5541dd1d3b18 could not be found. Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-114927b9-3301-4f87-b8e9-8dc586bcaaf9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Request method failure captured: Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 HTTP/1.1 Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOCyt5wNh_FEH36U-N0FQ8k_LyJAXtHZSu59k19ZVRspQaZUsZ2DfEOu4e8nxmFuU1dRPWLDo-7fs91ec5VLI_Y6xDsEXbioO6oijaevSZ7cyjgE4y4BNi72hFr6v9vZ7YV5VEpYuDxKOyg1RiPmTl3T5dBjovp0fu-vBs8xSx_6Gw Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 79b6d71ecbf94b7a81761727712881ea Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:43:54.203451 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79b6d71ecbf94b7a81761727712881ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/79b6d71ecbf94b7a81761727712881ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_79b6d71ecbf94b7a81761727712881ea", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/79b6d71ecbf94b7a81761727712881ea"}]}] Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 79b6d71ecbf94b7a81761727712881ea Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777922945 Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-ServerRescueNegativeTestJSON-777922945-project Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: b991805cfa834aab8dcab7d94d108ee2 Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777922945-project Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 7af6350f-5066-435f-bf01-5541dd1d3b18 could not be found. Jul 21 23:43:54.204993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '7af6350f-5066-435f-bf01-5541dd1d3b18'} Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af6350f-5066-435f-bf01-5541dd1d3b18 could not be found. Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:43:54.206035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af6350f-5066-435f-bf01-5541dd1d3b18 could not be found. Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af6350f-5066-435f-bf01-5541dd1d3b18 could not be found. Jul 21 23:43:54.207368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:54.208911 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-114927b9-3301-4f87-b8e9-8dc586bcaaf9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] Returning 404 to user: Instance 7af6350f-5066-435f-bf01-5541dd1d3b18 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:43:54.210089 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-114927b9-3301-4f87-b8e9-8dc586bcaaf9 tempest-ServerRescueNegativeTestJSON-777922945 tempest-ServerRescueNegativeTestJSON-777922945-project] 10.222.0.57 "GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18" status: 404 len: 111 microversion: 2.1 time: 0.044590 Jul 21 23:43:54.210767 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 365/693] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:54 2022] GET /compute/v2.1/servers/7af6350f-5066-435f-bf01-5541dd1d3b18 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:43:54.337180 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-9159a8ac-3e6b-4faf-99fc-05eba4064c98 req-7bbe6fa4-211c-4173-ad55-3d6d5d78a873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946cd660-c484-440f-873a-84c4c0a208fd", "name": "network-vif-deleted", "tag": "bf3d7700-4f6a-4ed5-976f-d98d0af517ec"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:54.355317 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-9159a8ac-3e6b-4faf-99fc-05eba4064c98 req-7bbe6fa4-211c-4173-ad55-3d6d5d78a873 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:54.356029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-9159a8ac-3e6b-4faf-99fc-05eba4064c98 req-7bbe6fa4-211c-4173-ad55-3d6d5d78a873 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:54.368339 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-9159a8ac-3e6b-4faf-99fc-05eba4064c98 req-7bbe6fa4-211c-4173-ad55-3d6d5d78a873 service nova] Creating event network-vif-deleted:bf3d7700-4f6a-4ed5-976f-d98d0af517ec for instance 946cd660-c484-440f-873a-84c4c0a208fd on hv-cinder-85070 Jul 21 23:43:54.382781 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-9159a8ac-3e6b-4faf-99fc-05eba4064c98 req-7bbe6fa4-211c-4173-ad55-3d6d5d78a873 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050715 Jul 21 23:43:54.384805 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 329/694] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:54.579522 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ecb47070-9b2f-43fa-88a1-af0f0c82bb02 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:54.580203 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ecb47070-9b2f-43fa-88a1-af0f0c82bb02 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:54.603914 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ecb47070-9b2f-43fa-88a1-af0f0c82bb02 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:54.604648 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ecb47070-9b2f-43fa-88a1-af0f0c82bb02 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:54.605663 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ecb47070-9b2f-43fa-88a1-af0f0c82bb02 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:54.607182 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ecb47070-9b2f-43fa-88a1-af0f0c82bb02 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:54.627537 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-ecb47070-9b2f-43fa-88a1-af0f0c82bb02 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] HTTP exception thrown: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ecb47070-9b2f-43fa-88a1-af0f0c82bb02 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Request method failure captured: Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd HTTP/1.1 Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2ePXFcmsxgyBLcJQWBwWfRx-PmL6Uj_XnhJDO3SJEuEGVMmnV-HuPbEx1XFA6WAacybJ6aN7L03OyY_BY0nTGphDTyu_oW01ZPws7Zg2YWLP1emGJ-M0eWu6HkSXrPJvyu1sptYU46InHK4qs5LhMaoV2yoWvpruuHAYYN3gN27B8XA Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:43:54.629268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c9b5eb6ef5a942be9fcea8b26370a6fc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}] Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 2768181f8a814902b8dcf50ce32907d0 Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:43:54.631001 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '946cd660-c484-440f-873a-84c4c0a208fd'} Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:43:54.631766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:43:54.632997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:43:54.634849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ecb47070-9b2f-43fa-88a1-af0f0c82bb02 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Returning 404 to user: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:43:54.634849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ecb47070-9b2f-43fa-88a1-af0f0c82bb02 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 404 len: 111 microversion: 2.1 time: 0.067210 Jul 21 23:43:54.636990 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 366/695] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:54 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:43:54.643408 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-343aa5a0-3fa0-4e3d-a029-564970d61659 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '.version_select at 0x7f7d288eb1f0>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:54.669499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-343aa5a0-3fa0-4e3d-a029-564970d61659 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098807467" status: 202 len: 0 microversion: 2.1 time: 0.029565 Jul 21 23:43:54.672005 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 330/696] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jul 21 23:43:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098807467 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:43:54.882375 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-eea4aa3e-7fd1-4f87-acd6-0d633b161790 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:54.883076 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-eea4aa3e-7fd1-4f87-acd6-0d633b161790 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:54.890847 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eea4aa3e-7fd1-4f87-acd6-0d633b161790 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:54.891546 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eea4aa3e-7fd1-4f87-acd6-0d633b161790 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:54.892569 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eea4aa3e-7fd1-4f87-acd6-0d633b161790 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:54.893161 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-eea4aa3e-7fd1-4f87-acd6-0d633b161790 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:54.923101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-eea4aa3e-7fd1-4f87-acd6-0d633b161790 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:43:55.035010 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-eea4aa3e-7fd1-4f87-acd6-0d633b161790 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 204 len: 0 microversion: 2.1 time: 0.156295 Jul 21 23:43:55.036301 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 367/697] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:43:54 2022] DELETE /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:43:55.045815 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2505329d-8258-4133-8b66-8b5085616102 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:55.046605 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2505329d-8258-4133-8b66-8b5085616102 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:55.054798 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2505329d-8258-4133-8b66-8b5085616102 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:55.055765 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2505329d-8258-4133-8b66-8b5085616102 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:55.056909 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2505329d-8258-4133-8b66-8b5085616102 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:55.057536 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2505329d-8258-4133-8b66-8b5085616102 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:55.315824 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2505329d-8258-4133-8b66-8b5085616102 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:55.328269 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2505329d-8258-4133-8b66-8b5085616102 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1555 microversion: 2.1 time: 0.287307 Jul 21 23:43:55.329497 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 331/698] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:55 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:55.648252 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cea7dd38-2f5d-4077-b403-735dd8696779 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Action: 'create', calling method: .version_select at 0x7f7d28ac13a0>, body: {"keypair": {"name": "tempest-keypair-1538121688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqOwHtZIyNsGhbkW3xzCrVemMM7CAtxlXwtPPw1x3X33igxpDVXrxNJGhAF6aIjw0HEa6PUJbdaLkq25kLI9NJ/a7P1D2OsaP5v1/SHU4BpM7RxRCQAK42XofMq3TCPWw=="}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:55.662989 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-cea7dd38-2f5d-4077-b403-735dd8696779 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Getting quotas for project c9b5eb6ef5a942be9fcea8b26370a6fc. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:43:55.666759 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-cea7dd38-2f5d-4077-b403-735dd8696779 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Getting quotas for user 2768181f8a814902b8dcf50ce32907d0 and project c9b5eb6ef5a942be9fcea8b26370a6fc. Resources: {'key_pairs'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:43:55.688984 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cea7dd38-2f5d-4077-b403-735dd8696779 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045007 Jul 21 23:43:55.689711 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 368/699] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 23:43:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:56.345247 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7961bb56-b8db-4b57-b00a-7e5621347d20 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:56.345971 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7961bb56-b8db-4b57-b00a-7e5621347d20 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:56.352634 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7961bb56-b8db-4b57-b00a-7e5621347d20 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:56.353082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7961bb56-b8db-4b57-b00a-7e5621347d20 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:56.353906 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7961bb56-b8db-4b57-b00a-7e5621347d20 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:56.354340 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7961bb56-b8db-4b57-b00a-7e5621347d20 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:56.579836 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7961bb56-b8db-4b57-b00a-7e5621347d20 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:56.611114 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7961bb56-b8db-4b57-b00a-7e5621347d20 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1555 microversion: 2.1 time: 0.269725 Jul 21 23:43:56.611697 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 332/700] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:56 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1555 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:57.634603 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5b0bdb82-c835-4a31-a81b-fe0d0a013e31 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:57.641726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5b0bdb82-c835-4a31-a81b-fe0d0a013e31 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:57.650313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5b0bdb82-c835-4a31-a81b-fe0d0a013e31 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:57.650915 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5b0bdb82-c835-4a31-a81b-fe0d0a013e31 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:57.651845 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5b0bdb82-c835-4a31-a81b-fe0d0a013e31 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:57.652333 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5b0bdb82-c835-4a31-a81b-fe0d0a013e31 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:57.864401 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5b0bdb82-c835-4a31-a81b-fe0d0a013e31 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ffdc9526374a07b696f5cc59b22ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235634c0fcf14ebeab084cfca36d394b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:57.877329 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5b0bdb82-c835-4a31-a81b-fe0d0a013e31 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 200 len: 1555 microversion: 2.1 time: 0.252677 Jul 21 23:43:57.878606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 369/701] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:57 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:43:57.921367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-52641892-e2ca-4e44-a8f2-467afc375b23 req-319a1d08-230b-4180-af34-da80bf289cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5fa3e4-c19a-40ef-8cec-92cd819d132f", "name": "network-vif-deleted", "tag": "3d912156-66c3-4060-a4b0-45f5c1b2da29"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:57.939782 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:57.953523 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-52641892-e2ca-4e44-a8f2-467afc375b23 req-319a1d08-230b-4180-af34-da80bf289cb0 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:57.955910 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-52641892-e2ca-4e44-a8f2-467afc375b23 req-319a1d08-230b-4180-af34-da80bf289cb0 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:57.994767 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-52641892-e2ca-4e44-a8f2-467afc375b23 req-319a1d08-230b-4180-af34-da80bf289cb0 service nova] Creating event network-vif-deleted:3d912156-66c3-4060-a4b0-45f5c1b2da29 for instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f on hv-cinder-85070 Jul 21 23:43:58.003025 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-52641892-e2ca-4e44-a8f2-467afc375b23 req-319a1d08-230b-4180-af34-da80bf289cb0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097137 Jul 21 23:43:58.003684 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 333/702] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:43:58.213114 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-693681696", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "def9c3d1-b527-4217-aca8-1be03de9052a"}], "security_groups": [{"name": "tempest-securitygroup--608504159"}], "key_name": "tempest-keypair-1538121688", "user_data": "}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:43:58.413389 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] validate_networks() for [('def9c3d1-b527-4217-aca8-1be03de9052a', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:43:58.897504 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e952f32b-0961-4960-8222-3949d6cac287 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:58.898344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e952f32b-0961-4960-8222-3949d6cac287 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] [instance: 2e5fa3e4-c19a-40ef-8cec-92cd819d132f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:58.910051 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e952f32b-0961-4960-8222-3949d6cac287 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:58.910576 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e952f32b-0961-4960-8222-3949d6cac287 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:58.911737 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e952f32b-0961-4960-8222-3949d6cac287 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:58.912307 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e952f32b-0961-4960-8222-3949d6cac287 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:58.925976 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-e952f32b-0961-4960-8222-3949d6cac287 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] HTTP exception thrown: Instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f could not be found. Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e952f32b-0961-4960-8222-3949d6cac287 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Request method failure captured: Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f HTTP/1.1 Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2ePpb2H5q0MTYWMJVXPtsVKGUc8jVkM8vPNETRK8j3kBz23Y-8qjMal4HJ2fIiiI3t8_FMfgxsmQmiCdKPmxCz9hafgYzfDLWOFb743ZrxrE6KvWAJPsepv3RXBq6aCvEQ76GClzkkulw-1_lNjr7cCa_YKySwIKDqipMjvo8hSDPgA Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 235634c0fcf14ebeab084cfca36d394b Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-TestMinimumBasicScenario-1318923754 Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:43:58.928283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/235634c0fcf14ebeab084cfca36d394b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/235634c0fcf14ebeab084cfca36d394b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_235634c0fcf14ebeab084cfca36d394b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/235634c0fcf14ebeab084cfca36d394b"}]}] Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-TestMinimumBasicScenario-1318923754 Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 235634c0fcf14ebeab084cfca36d394b Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1318923754 Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-TestMinimumBasicScenario-1318923754-project Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 33ffdc9526374a07b696f5cc59b22ef7 Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-TestMinimumBasicScenario-1318923754-project Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f could not be found. Jul 21 23:43:58.929862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': '2e5fa3e4-c19a-40ef-8cec-92cd819d132f'} Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f could not be found. Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:43:58.930728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f could not be found. Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f could not be found. Jul 21 23:43:58.932141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:43:58.934001 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e952f32b-0961-4960-8222-3949d6cac287 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Returning 404 to user: Instance 2e5fa3e4-c19a-40ef-8cec-92cd819d132f could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:43:58.934834 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e952f32b-0961-4960-8222-3949d6cac287 tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f" status: 404 len: 111 microversion: 2.1 time: 0.042754 Jul 21 23:43:58.935757 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 334/703] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:58 2022] GET /compute/v2.1/servers/2e5fa3e4-c19a-40ef-8cec-92cd819d132f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:43:58.944677 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4820ceb3-4513-47fb-bb15-2ac68a8790ac tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] Calling method '.version_select at 0x7f7d28a673a0>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:58.964535 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4820ceb3-4513-47fb-bb15-2ac68a8790ac tempest-TestMinimumBasicScenario-1318923754 tempest-TestMinimumBasicScenario-1318923754-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1324508426" status: 202 len: 0 microversion: 2.1 time: 0.023447 Jul 21 23:43:58.965103 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 335/704] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jul 21 23:43:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1324508426 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:43:58.991517 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:43:58.992136 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:43:58.992824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:43:58.993538 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:43:58.994017 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:43:59.008551 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:59.009336 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:59.010690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:43:59.011426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:43:59.031784 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Getting quotas for project c9b5eb6ef5a942be9fcea8b26370a6fc. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:43:59.035837 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Getting quotas for user 2768181f8a814902b8dcf50ce32907d0 and project c9b5eb6ef5a942be9fcea8b26370a6fc. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:43:59.050366 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:43:59.053037 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:43:59.105316 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e8c621c8-4e47-4c87-979f-0bb1408f9225 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.906400 Jul 21 23:43:59.105806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 370/705] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:43:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:43:59.117745 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0a87f4e3-66bd-40fe-a0ed-16bd5e103e61 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:43:59.125558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0a87f4e3-66bd-40fe-a0ed-16bd5e103e61 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:43:59.200236 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0a87f4e3-66bd-40fe-a0ed-16bd5e103e61 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:43:59.208674 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0a87f4e3-66bd-40fe-a0ed-16bd5e103e61 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1237 microversion: 2.1 time: 0.095461 Jul 21 23:43:59.209259 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 336/706] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:43:59 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:00.224922 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f922e430-6633-4440-89d9-47761698ad7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:00.226205 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f922e430-6633-4440-89d9-47761698ad7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:00.233843 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f922e430-6633-4440-89d9-47761698ad7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:00.234587 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f922e430-6633-4440-89d9-47761698ad7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:00.235582 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f922e430-6633-4440-89d9-47761698ad7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:00.236206 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f922e430-6633-4440-89d9-47761698ad7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:00.335220 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-f922e430-6633-4440-89d9-47761698ad7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:00.349437 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f922e430-6633-4440-89d9-47761698ad7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1289 microversion: 2.1 time: 0.127631 Jul 21 23:44:00.350322 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 371/707] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:00 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1289 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:01.214070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d3280695-1b78-44c3-b4da-40fe7cf2fefc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:01.214695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d3280695-1b78-44c3-b4da-40fe7cf2fefc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:01.221666 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3280695-1b78-44c3-b4da-40fe7cf2fefc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:01.222127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3280695-1b78-44c3-b4da-40fe7cf2fefc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:01.222927 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3280695-1b78-44c3-b4da-40fe7cf2fefc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:01.223364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3280695-1b78-44c3-b4da-40fe7cf2fefc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:01.263631 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d3280695-1b78-44c3-b4da-40fe7cf2fefc tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/ips" status: 200 len: 151 microversion: 2.20 time: 0.367127 Jul 21 23:44:01.270056 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 337/708] 10.222.0.57 () {60 vars in 1288 bytes} [Thu Jul 21 23:44:00 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/ips => generated 151 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:44:01.367859 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e929c4e2-8fb8-465c-babd-e6d3148d569b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:01.368725 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e929c4e2-8fb8-465c-babd-e6d3148d569b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:01.380691 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e929c4e2-8fb8-465c-babd-e6d3148d569b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:01.381398 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e929c4e2-8fb8-465c-babd-e6d3148d569b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:01.382330 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e929c4e2-8fb8-465c-babd-e6d3148d569b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:01.382919 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e929c4e2-8fb8-465c-babd-e6d3148d569b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:01.631497 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e929c4e2-8fb8-465c-babd-e6d3148d569b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:01.646333 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e929c4e2-8fb8-465c-babd-e6d3148d569b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1362 microversion: 2.1 time: 0.282409 Jul 21 23:44:01.653328 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 372/709] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:01 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:02.101794 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-4d5d1321-f48e-4b59-975e-d9c181d14936 req-53311266-bb4f-46c0-b94e-8ed7cc805403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f95480-1f4a-48a2-8159-c7928d21cdd2", "tag": "f00c42eb-3b9e-4025-bfef-697e24e64c46"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:02.120623 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-4d5d1321-f48e-4b59-975e-d9c181d14936 req-53311266-bb4f-46c0-b94e-8ed7cc805403 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:02.121931 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-4d5d1321-f48e-4b59-975e-d9c181d14936 req-53311266-bb4f-46c0-b94e-8ed7cc805403 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:02.136530 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-4d5d1321-f48e-4b59-975e-d9c181d14936 req-53311266-bb4f-46c0-b94e-8ed7cc805403 service nova] Creating event network-changed:f00c42eb-3b9e-4025-bfef-697e24e64c46 for instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 on hv-cinder-85070 Jul 21 23:44:02.143688 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-4d5d1321-f48e-4b59-975e-d9c181d14936 req-53311266-bb4f-46c0-b94e-8ed7cc805403 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047300 Jul 21 23:44:02.144492 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 338/710] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:02.663773 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-231585dc-3cb3-481f-89d6-9bd85ad3a771 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:02.664504 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-231585dc-3cb3-481f-89d6-9bd85ad3a771 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:02.674192 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-231585dc-3cb3-481f-89d6-9bd85ad3a771 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:02.674405 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-231585dc-3cb3-481f-89d6-9bd85ad3a771 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:02.675484 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-231585dc-3cb3-481f-89d6-9bd85ad3a771 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:02.676273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-231585dc-3cb3-481f-89d6-9bd85ad3a771 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:02.704574 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:02.878246 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-231585dc-3cb3-481f-89d6-9bd85ad3a771 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:02.892803 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-231585dc-3cb3-481f-89d6-9bd85ad3a771 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1362 microversion: 2.1 time: 0.233278 Jul 21 23:44:02.893589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 373/711] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:02 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:03.261457 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-28ca6057-34c2-4ba6-8927-a8fbac0b5d7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:03.262085 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-28ca6057-34c2-4ba6-8927-a8fbac0b5d7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:03.268755 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28ca6057-34c2-4ba6-8927-a8fbac0b5d7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:03.269359 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28ca6057-34c2-4ba6-8927-a8fbac0b5d7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:03.270401 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28ca6057-34c2-4ba6-8927-a8fbac0b5d7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:03.271000 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28ca6057-34c2-4ba6-8927-a8fbac0b5d7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:03.296680 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.objects.instance [None req-28ca6057-34c2-4ba6-8927-a8fbac0b5d7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lazy-loading 'flavor' on Instance uuid a8c3804b-cf30-461e-8f8c-30250027a445 {{(pid=124387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:44:03.326326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:03.635353 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-28ca6057-34c2-4ba6-8927-a8fbac0b5d7c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "POST /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/action" status: 202 len: 0 microversion: 2.20 time: 0.378569 Jul 21 23:44:03.636278 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 339/712] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jul 21 23:44:03 2022] POST /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:44:03.644751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3ca46fe3-f9b8-4cc1-b1fb-f18ff709d551 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:03.645640 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3ca46fe3-f9b8-4cc1-b1fb-f18ff709d551 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:03.652184 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3ca46fe3-f9b8-4cc1-b1fb-f18ff709d551 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:03.652636 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3ca46fe3-f9b8-4cc1-b1fb-f18ff709d551 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:03.654819 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3ca46fe3-f9b8-4cc1-b1fb-f18ff709d551 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:03.655467 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3ca46fe3-f9b8-4cc1-b1fb-f18ff709d551 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:03.835428 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3ca46fe3-f9b8-4cc1-b1fb-f18ff709d551 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:03.849863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3ca46fe3-f9b8-4cc1-b1fb-f18ff709d551 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:03.851383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3ca46fe3-f9b8-4cc1-b1fb-f18ff709d551 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:03.852574 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3ca46fe3-f9b8-4cc1-b1fb-f18ff709d551 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1723 microversion: 2.20 time: 0.211687 Jul 21 23:44:03.853128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 374/713] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:03 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:03.915037 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bd087a68-e5af-4161-9215-11570f854210 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:03.915747 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bd087a68-e5af-4161-9215-11570f854210 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:03.922498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd087a68-e5af-4161-9215-11570f854210 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:03.922937 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd087a68-e5af-4161-9215-11570f854210 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:03.923703 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd087a68-e5af-4161-9215-11570f854210 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:03.924130 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bd087a68-e5af-4161-9215-11570f854210 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:04.159250 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bd087a68-e5af-4161-9215-11570f854210 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:04.168365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bd087a68-e5af-4161-9215-11570f854210 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1362 microversion: 2.1 time: 0.261946 Jul 21 23:44:04.169115 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 340/714] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:03 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:04.873081 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ae9c036b-b5a9-4f7d-97ae-5ec8f09dc27f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:04.873736 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ae9c036b-b5a9-4f7d-97ae-5ec8f09dc27f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:04.880838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae9c036b-b5a9-4f7d-97ae-5ec8f09dc27f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:04.881879 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae9c036b-b5a9-4f7d-97ae-5ec8f09dc27f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:04.882863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae9c036b-b5a9-4f7d-97ae-5ec8f09dc27f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:04.883474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae9c036b-b5a9-4f7d-97ae-5ec8f09dc27f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:05.118936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ae9c036b-b5a9-4f7d-97ae-5ec8f09dc27f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:05.133693 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ae9c036b-b5a9-4f7d-97ae-5ec8f09dc27f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:05.135766 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ae9c036b-b5a9-4f7d-97ae-5ec8f09dc27f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:05.137166 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ae9c036b-b5a9-4f7d-97ae-5ec8f09dc27f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1723 microversion: 2.20 time: 0.269016 Jul 21 23:44:05.137859 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 375/715] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:04 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:05.187105 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-15cccb2c-2df9-4a51-b580-6a72fd51309b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:05.188336 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-15cccb2c-2df9-4a51-b580-6a72fd51309b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:05.195336 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-15cccb2c-2df9-4a51-b580-6a72fd51309b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:05.195781 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-15cccb2c-2df9-4a51-b580-6a72fd51309b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:05.196590 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-15cccb2c-2df9-4a51-b580-6a72fd51309b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:05.197029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-15cccb2c-2df9-4a51-b580-6a72fd51309b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:05.339134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-15cccb2c-2df9-4a51-b580-6a72fd51309b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:05.347343 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-15cccb2c-2df9-4a51-b580-6a72fd51309b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1362 microversion: 2.1 time: 0.165085 Jul 21 23:44:05.347912 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 341/716] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:05 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:44:06.155924 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cf694c6f-9a46-4560-9922-d4476e507ad4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:06.159163 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cf694c6f-9a46-4560-9922-d4476e507ad4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:06.172098 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf694c6f-9a46-4560-9922-d4476e507ad4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:06.173028 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf694c6f-9a46-4560-9922-d4476e507ad4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:06.174296 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf694c6f-9a46-4560-9922-d4476e507ad4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:06.175151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cf694c6f-9a46-4560-9922-d4476e507ad4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:06.295553 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-b69b2d0c-9ae7-4b60-8f26-28f96e2c60ee req-6bcdb072-37d8-4f68-9cf4-2f58d6f73344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f95480-1f4a-48a2-8159-c7928d21cdd2", "name": "network-vif-plugged", "status": "completed", "tag": "f00c42eb-3b9e-4025-bfef-697e24e64c46"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:06.312305 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-b69b2d0c-9ae7-4b60-8f26-28f96e2c60ee req-6bcdb072-37d8-4f68-9cf4-2f58d6f73344 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:06.312654 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-b69b2d0c-9ae7-4b60-8f26-28f96e2c60ee req-6bcdb072-37d8-4f68-9cf4-2f58d6f73344 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:06.342241 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-b69b2d0c-9ae7-4b60-8f26-28f96e2c60ee req-6bcdb072-37d8-4f68-9cf4-2f58d6f73344 service nova] Creating event network-vif-plugged:f00c42eb-3b9e-4025-bfef-697e24e64c46 for instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 on hv-cinder-85070 Jul 21 23:44:06.355133 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-b69b2d0c-9ae7-4b60-8f26-28f96e2c60ee req-6bcdb072-37d8-4f68-9cf4-2f58d6f73344 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057048 Jul 21 23:44:06.356050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 342/717] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:44:06.364118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e3490ed7-f59a-44bf-82f6-f3b5068f4074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:06.385237 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e3490ed7-f59a-44bf-82f6-f3b5068f4074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:06.400799 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e3490ed7-f59a-44bf-82f6-f3b5068f4074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:06.401518 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e3490ed7-f59a-44bf-82f6-f3b5068f4074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:06.402444 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e3490ed7-f59a-44bf-82f6-f3b5068f4074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:06.403029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e3490ed7-f59a-44bf-82f6-f3b5068f4074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:06.460488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cf694c6f-9a46-4560-9922-d4476e507ad4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:06.473631 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cf694c6f-9a46-4560-9922-d4476e507ad4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:06.475494 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cf694c6f-9a46-4560-9922-d4476e507ad4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:06.476701 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cf694c6f-9a46-4560-9922-d4476e507ad4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1723 microversion: 2.20 time: 0.324753 Jul 21 23:44:06.477645 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 376/718] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:06 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:07.072564 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e3490ed7-f59a-44bf-82f6-f3b5068f4074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:07.082937 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e3490ed7-f59a-44bf-82f6-f3b5068f4074 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1362 microversion: 2.1 time: 0.722832 Jul 21 23:44:07.092931 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 343/719] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:06 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1362 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:07.495824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5e835ffe-f02d-42c6-b16f-26a06e5bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:07.496499 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5e835ffe-f02d-42c6-b16f-26a06e5bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:07.509675 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5e835ffe-f02d-42c6-b16f-26a06e5bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:07.510208 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5e835ffe-f02d-42c6-b16f-26a06e5bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:07.511044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5e835ffe-f02d-42c6-b16f-26a06e5bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:07.511600 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5e835ffe-f02d-42c6-b16f-26a06e5bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:07.673318 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5e835ffe-f02d-42c6-b16f-26a06e5bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:07.687846 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5e835ffe-f02d-42c6-b16f-26a06e5bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:07.689997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5e835ffe-f02d-42c6-b16f-26a06e5bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:07.692222 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5e835ffe-f02d-42c6-b16f-26a06e5bc99a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1723 microversion: 2.20 time: 0.200302 Jul 21 23:44:07.693402 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 377/720] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:07 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:08.100126 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-93636bb0-5423-46fc-8625-3ec1ccd78dd0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:08.100742 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-93636bb0-5423-46fc-8625-3ec1ccd78dd0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:08.108155 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-93636bb0-5423-46fc-8625-3ec1ccd78dd0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:08.108617 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-93636bb0-5423-46fc-8625-3ec1ccd78dd0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:08.109503 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-93636bb0-5423-46fc-8625-3ec1ccd78dd0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:08.110327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-93636bb0-5423-46fc-8625-3ec1ccd78dd0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:08.270505 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-93636bb0-5423-46fc-8625-3ec1ccd78dd0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:08.277923 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-93636bb0-5423-46fc-8625-3ec1ccd78dd0 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1362 microversion: 2.1 time: 0.181762 Jul 21 23:44:08.278494 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 344/721] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:08 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:08.711963 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5dce1d7c-f0dd-40ac-9ed0-3a9376b59d99 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:08.712594 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5dce1d7c-f0dd-40ac-9ed0-3a9376b59d99 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:08.722219 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5dce1d7c-f0dd-40ac-9ed0-3a9376b59d99 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:08.723741 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5dce1d7c-f0dd-40ac-9ed0-3a9376b59d99 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:08.725550 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5dce1d7c-f0dd-40ac-9ed0-3a9376b59d99 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:08.726305 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5dce1d7c-f0dd-40ac-9ed0-3a9376b59d99 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:08.876380 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5dce1d7c-f0dd-40ac-9ed0-3a9376b59d99 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:08.888325 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5dce1d7c-f0dd-40ac-9ed0-3a9376b59d99 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:08.890481 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5dce1d7c-f0dd-40ac-9ed0-3a9376b59d99 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:08.891690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5dce1d7c-f0dd-40ac-9ed0-3a9376b59d99 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1723 microversion: 2.20 time: 0.185132 Jul 21 23:44:08.892258 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 378/722] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:08 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:09.296815 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f7221150-d242-4dcb-b2eb-fa9efba837bc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:09.297642 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f7221150-d242-4dcb-b2eb-fa9efba837bc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:09.299880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:09.305445 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f7221150-d242-4dcb-b2eb-fa9efba837bc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:09.306151 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f7221150-d242-4dcb-b2eb-fa9efba837bc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:09.307122 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f7221150-d242-4dcb-b2eb-fa9efba837bc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:09.307720 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f7221150-d242-4dcb-b2eb-fa9efba837bc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:09.468797 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f7221150-d242-4dcb-b2eb-fa9efba837bc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:09.477375 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f7221150-d242-4dcb-b2eb-fa9efba837bc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1549 microversion: 2.1 time: 0.184652 Jul 21 23:44:09.478216 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 345/723] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:09 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1549 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:09.495017 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e8a1246e-4169-48a2-88cd-87853e4099b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:09.495510 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e8a1246e-4169-48a2-88cd-87853e4099b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:09.497590 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:09.498704 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=10 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:09.505143 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8a1246e-4169-48a2-88cd-87853e4099b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:09.505649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8a1246e-4169-48a2-88cd-87853e4099b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:09.506442 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8a1246e-4169-48a2-88cd-87853e4099b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:09.506881 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e8a1246e-4169-48a2-88cd-87853e4099b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:09.599399 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e8a1246e-4169-48a2-88cd-87853e4099b6 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108304 Jul 21 23:44:09.600745 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 379/724] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 23:44:09 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:09.910041 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b201edf6-35d4-4242-ba36-1c2efd4e337e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:09.911150 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b201edf6-35d4-4242-ba36-1c2efd4e337e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:09.917444 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b201edf6-35d4-4242-ba36-1c2efd4e337e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:09.917907 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b201edf6-35d4-4242-ba36-1c2efd4e337e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:09.918664 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b201edf6-35d4-4242-ba36-1c2efd4e337e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:09.919107 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b201edf6-35d4-4242-ba36-1c2efd4e337e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:10.070603 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b201edf6-35d4-4242-ba36-1c2efd4e337e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:10.081078 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b201edf6-35d4-4242-ba36-1c2efd4e337e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:10.083097 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b201edf6-35d4-4242-ba36-1c2efd4e337e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:10.084782 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b201edf6-35d4-4242-ba36-1c2efd4e337e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1723 microversion: 2.20 time: 0.178582 Jul 21 23:44:10.085902 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 346/725] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:09 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:10.815440 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-4b0abaaa-687c-48b2-baa1-b7dd69e32b78 req-5f4c7e66-d626-4e34-af53-03b56c59ba96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f95480-1f4a-48a2-8159-c7928d21cdd2", "tag": "f00c42eb-3b9e-4025-bfef-697e24e64c46"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:10.830169 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4b0abaaa-687c-48b2-baa1-b7dd69e32b78 req-5f4c7e66-d626-4e34-af53-03b56c59ba96 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:10.830718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4b0abaaa-687c-48b2-baa1-b7dd69e32b78 req-5f4c7e66-d626-4e34-af53-03b56c59ba96 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:10.843577 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-4b0abaaa-687c-48b2-baa1-b7dd69e32b78 req-5f4c7e66-d626-4e34-af53-03b56c59ba96 service nova] Creating event network-changed:f00c42eb-3b9e-4025-bfef-697e24e64c46 for instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 on hv-cinder-85070 Jul 21 23:44:10.850595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-4b0abaaa-687c-48b2-baa1-b7dd69e32b78 req-5f4c7e66-d626-4e34-af53-03b56c59ba96 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264181 Jul 21 23:44:10.851899 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 380/726] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:11.104338 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-13aa4057-02b3-412c-8cf8-b65771528a35 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:11.105586 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-13aa4057-02b3-412c-8cf8-b65771528a35 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:11.113930 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13aa4057-02b3-412c-8cf8-b65771528a35 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:11.114564 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13aa4057-02b3-412c-8cf8-b65771528a35 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:11.115764 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13aa4057-02b3-412c-8cf8-b65771528a35 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:11.116368 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-13aa4057-02b3-412c-8cf8-b65771528a35 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:11.355586 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-13aa4057-02b3-412c-8cf8-b65771528a35 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:11.363824 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-13aa4057-02b3-412c-8cf8-b65771528a35 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:11.365629 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-13aa4057-02b3-412c-8cf8-b65771528a35 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:11.368399 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-13aa4057-02b3-412c-8cf8-b65771528a35 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1723 microversion: 2.20 time: 0.268352 Jul 21 23:44:11.370698 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 347/727] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:11 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:12.389367 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e746dda9-6ca7-455a-9e8a-3534e68be0e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:12.389966 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e746dda9-6ca7-455a-9e8a-3534e68be0e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:12.396167 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e746dda9-6ca7-455a-9e8a-3534e68be0e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:12.396613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e746dda9-6ca7-455a-9e8a-3534e68be0e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:12.397416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e746dda9-6ca7-455a-9e8a-3534e68be0e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:12.397853 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e746dda9-6ca7-455a-9e8a-3534e68be0e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:12.530301 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e746dda9-6ca7-455a-9e8a-3534e68be0e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:12.538126 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e746dda9-6ca7-455a-9e8a-3534e68be0e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:12.539613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e746dda9-6ca7-455a-9e8a-3534e68be0e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:12.540760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e746dda9-6ca7-455a-9e8a-3534e68be0e5 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1723 microversion: 2.20 time: 0.156936 Jul 21 23:44:12.541342 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 381/728] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:12 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:13.558843 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-04c207f7-8ac2-4ddb-8acd-16a15a597e84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:13.559454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-04c207f7-8ac2-4ddb-8acd-16a15a597e84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:13.566352 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-04c207f7-8ac2-4ddb-8acd-16a15a597e84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:13.566804 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-04c207f7-8ac2-4ddb-8acd-16a15a597e84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:13.567567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-04c207f7-8ac2-4ddb-8acd-16a15a597e84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:13.568004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-04c207f7-8ac2-4ddb-8acd-16a15a597e84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:13.849722 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-04c207f7-8ac2-4ddb-8acd-16a15a597e84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:13.858081 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-04c207f7-8ac2-4ddb-8acd-16a15a597e84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:13.859581 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-04c207f7-8ac2-4ddb-8acd-16a15a597e84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:13.860735 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-04c207f7-8ac2-4ddb-8acd-16a15a597e84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1723 microversion: 2.20 time: 0.305875 Jul 21 23:44:13.861301 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 348/729] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:13 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:14.880371 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a1d6cde6-cf9b-4d3e-8242-9a4675f2a250 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:14.881106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a1d6cde6-cf9b-4d3e-8242-9a4675f2a250 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:14.890717 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1d6cde6-cf9b-4d3e-8242-9a4675f2a250 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:14.891300 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1d6cde6-cf9b-4d3e-8242-9a4675f2a250 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:14.893040 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1d6cde6-cf9b-4d3e-8242-9a4675f2a250 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:14.893582 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1d6cde6-cf9b-4d3e-8242-9a4675f2a250 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:15.038170 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a1d6cde6-cf9b-4d3e-8242-9a4675f2a250 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:15.046822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a1d6cde6-cf9b-4d3e-8242-9a4675f2a250 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:15.048311 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a1d6cde6-cf9b-4d3e-8242-9a4675f2a250 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:15.049530 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a1d6cde6-cf9b-4d3e-8242-9a4675f2a250 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1744 microversion: 2.20 time: 0.173694 Jul 21 23:44:15.050066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 382/730] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:14 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:16.067803 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-53fad929-1f85-4a23-914e-882decc279be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:16.068632 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-53fad929-1f85-4a23-914e-882decc279be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:16.077602 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-53fad929-1f85-4a23-914e-882decc279be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:16.078066 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-53fad929-1f85-4a23-914e-882decc279be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:16.078831 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-53fad929-1f85-4a23-914e-882decc279be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:16.079267 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-53fad929-1f85-4a23-914e-882decc279be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:16.219197 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-53fad929-1f85-4a23-914e-882decc279be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:16.228007 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-53fad929-1f85-4a23-914e-882decc279be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:16.229523 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-53fad929-1f85-4a23-914e-882decc279be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:16.230814 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-53fad929-1f85-4a23-914e-882decc279be tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1744 microversion: 2.20 time: 0.166929 Jul 21 23:44:16.231357 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 349/731] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:16 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:17.250168 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bb1317d4-f8be-4f0f-8157-713800f0786a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:17.250775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bb1317d4-f8be-4f0f-8157-713800f0786a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:17.257504 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb1317d4-f8be-4f0f-8157-713800f0786a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:17.258154 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb1317d4-f8be-4f0f-8157-713800f0786a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:17.259099 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb1317d4-f8be-4f0f-8157-713800f0786a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:17.259694 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb1317d4-f8be-4f0f-8157-713800f0786a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:17.486708 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bb1317d4-f8be-4f0f-8157-713800f0786a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:17.506683 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bb1317d4-f8be-4f0f-8157-713800f0786a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:17.509544 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bb1317d4-f8be-4f0f-8157-713800f0786a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:17.510749 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bb1317d4-f8be-4f0f-8157-713800f0786a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1739 microversion: 2.20 time: 0.265121 Jul 21 23:44:17.511513 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 383/732] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:17 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:18.514691 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-83e3c9d7-1425-4edc-ad77-67ca9ddcda03 req-a5c6fe70-f606-4751-a51a-0d3b4ba00d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c3804b-cf30-461e-8f8c-30250027a445", "name": "network-vif-plugged", "status": "completed", "tag": "dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:18.527908 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-83e3c9d7-1425-4edc-ad77-67ca9ddcda03 req-a5c6fe70-f606-4751-a51a-0d3b4ba00d56 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:18.528494 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-83e3c9d7-1425-4edc-ad77-67ca9ddcda03 req-a5c6fe70-f606-4751-a51a-0d3b4ba00d56 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:18.529647 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e55fd332-1bd0-4d2b-a5f1-c43ba6732581 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:18.530925 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e55fd332-1bd0-4d2b-a5f1-c43ba6732581 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:18.541423 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e55fd332-1bd0-4d2b-a5f1-c43ba6732581 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:18.542609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e55fd332-1bd0-4d2b-a5f1-c43ba6732581 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:18.543547 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e55fd332-1bd0-4d2b-a5f1-c43ba6732581 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:18.544786 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e55fd332-1bd0-4d2b-a5f1-c43ba6732581 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:18.549561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-83e3c9d7-1425-4edc-ad77-67ca9ddcda03 req-a5c6fe70-f606-4751-a51a-0d3b4ba00d56 service nova] Creating event network-vif-plugged:dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e for instance a8c3804b-cf30-461e-8f8c-30250027a445 on hv-cinder-85070 Jul 21 23:44:18.558673 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-83e3c9d7-1425-4edc-ad77-67ca9ddcda03 req-a5c6fe70-f606-4751-a51a-0d3b4ba00d56 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260540 Jul 21 23:44:18.560137 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 350/733] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:18.733580 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e55fd332-1bd0-4d2b-a5f1-c43ba6732581 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:18.743504 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e55fd332-1bd0-4d2b-a5f1-c43ba6732581 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:18.745319 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e55fd332-1bd0-4d2b-a5f1-c43ba6732581 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:18.746625 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e55fd332-1bd0-4d2b-a5f1-c43ba6732581 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1739 microversion: 2.20 time: 0.220843 Jul 21 23:44:18.748502 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 384/734] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:18 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:19.768608 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d6a57168-c260-423a-9d52-cf19b3f4591d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:19.769641 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d6a57168-c260-423a-9d52-cf19b3f4591d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:19.777141 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d6a57168-c260-423a-9d52-cf19b3f4591d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:19.778707 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d6a57168-c260-423a-9d52-cf19b3f4591d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:19.779916 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d6a57168-c260-423a-9d52-cf19b3f4591d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:19.782079 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d6a57168-c260-423a-9d52-cf19b3f4591d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:19.915965 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-246eab09-19c2-474c-97c9-9cf4bc25fc8d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:19.916457 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-246eab09-19c2-474c-97c9-9cf4bc25fc8d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:19.938843 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-246eab09-19c2-474c-97c9-9cf4bc25fc8d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:19.939609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-246eab09-19c2-474c-97c9-9cf4bc25fc8d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:19.941542 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-246eab09-19c2-474c-97c9-9cf4bc25fc8d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:19.942204 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-246eab09-19c2-474c-97c9-9cf4bc25fc8d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:19.981735 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-246eab09-19c2-474c-97c9-9cf4bc25fc8d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:44:19.988647 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d6a57168-c260-423a-9d52-cf19b3f4591d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:20.002446 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d6a57168-c260-423a-9d52-cf19b3f4591d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:20.003960 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d6a57168-c260-423a-9d52-cf19b3f4591d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:20.010518 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d6a57168-c260-423a-9d52-cf19b3f4591d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1739 microversion: 2.20 time: 0.246721 Jul 21 23:44:20.011759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 351/735] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:19 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:20.135224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-246eab09-19c2-474c-97c9-9cf4bc25fc8d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 204 len: 0 microversion: 2.1 time: 0.222699 Jul 21 23:44:20.136423 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 385/736] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:44:19 2022] DELETE /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 23:44:20.148995 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-30f51d4e-3ad7-4bc0-bd4a-e51eb01163fc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:20.149693 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-30f51d4e-3ad7-4bc0-bd4a-e51eb01163fc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:20.163276 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-30f51d4e-3ad7-4bc0-bd4a-e51eb01163fc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:20.164918 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-30f51d4e-3ad7-4bc0-bd4a-e51eb01163fc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:20.166408 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-30f51d4e-3ad7-4bc0-bd4a-e51eb01163fc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:20.168433 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-30f51d4e-3ad7-4bc0-bd4a-e51eb01163fc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:20.378949 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-30f51d4e-3ad7-4bc0-bd4a-e51eb01163fc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:20.389611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-30f51d4e-3ad7-4bc0-bd4a-e51eb01163fc tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1578 microversion: 2.1 time: 0.247108 Jul 21 23:44:20.390422 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 352/737] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:20 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1578 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:21.046797 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1038b53f-0891-4ef1-b7f3-807f8dbea926 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:21.048344 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1038b53f-0891-4ef1-b7f3-807f8dbea926 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:21.056544 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1038b53f-0891-4ef1-b7f3-807f8dbea926 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:21.057392 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1038b53f-0891-4ef1-b7f3-807f8dbea926 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:21.058443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1038b53f-0891-4ef1-b7f3-807f8dbea926 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:21.059059 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1038b53f-0891-4ef1-b7f3-807f8dbea926 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:21.239220 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1038b53f-0891-4ef1-b7f3-807f8dbea926 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:21.248923 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1038b53f-0891-4ef1-b7f3-807f8dbea926 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:21.250791 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1038b53f-0891-4ef1-b7f3-807f8dbea926 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:21.252316 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1038b53f-0891-4ef1-b7f3-807f8dbea926 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1739 microversion: 2.20 time: 0.226921 Jul 21 23:44:21.262011 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 386/738] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:21 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:21.408771 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2223344c-eca5-499c-8e96-a97cf602b01d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:21.410035 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2223344c-eca5-499c-8e96-a97cf602b01d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:21.417471 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2223344c-eca5-499c-8e96-a97cf602b01d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:21.418182 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2223344c-eca5-499c-8e96-a97cf602b01d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:21.419320 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2223344c-eca5-499c-8e96-a97cf602b01d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:21.420050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2223344c-eca5-499c-8e96-a97cf602b01d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:21.644147 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2223344c-eca5-499c-8e96-a97cf602b01d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:21.660278 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2223344c-eca5-499c-8e96-a97cf602b01d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1578 microversion: 2.1 time: 0.256874 Jul 21 23:44:21.661108 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 353/739] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:21 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1578 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:22.279532 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a0318145-a997-495a-ae23-0abb07254f33 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:22.280273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a0318145-a997-495a-ae23-0abb07254f33 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:22.290123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a0318145-a997-495a-ae23-0abb07254f33 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:22.297206 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a0318145-a997-495a-ae23-0abb07254f33 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:22.298247 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a0318145-a997-495a-ae23-0abb07254f33 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:22.303826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a0318145-a997-495a-ae23-0abb07254f33 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:22.558291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a0318145-a997-495a-ae23-0abb07254f33 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:22.573760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a0318145-a997-495a-ae23-0abb07254f33 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:22.578670 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a0318145-a997-495a-ae23-0abb07254f33 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:22.586527 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a0318145-a997-495a-ae23-0abb07254f33 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1739 microversion: 2.20 time: 0.313314 Jul 21 23:44:22.589960 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 387/740] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:22 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1739 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:22.687734 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6acb544d-36bb-4a47-b02e-2e452dbf3a56 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:22.689612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6acb544d-36bb-4a47-b02e-2e452dbf3a56 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:22.711491 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6acb544d-36bb-4a47-b02e-2e452dbf3a56 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:22.712101 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6acb544d-36bb-4a47-b02e-2e452dbf3a56 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:22.713027 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6acb544d-36bb-4a47-b02e-2e452dbf3a56 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:22.716423 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6acb544d-36bb-4a47-b02e-2e452dbf3a56 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:22.844192 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6acb544d-36bb-4a47-b02e-2e452dbf3a56 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:22.869281 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6acb544d-36bb-4a47-b02e-2e452dbf3a56 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1511 microversion: 2.1 time: 0.193304 Jul 21 23:44:22.874497 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 354/741] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:22 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:23.409140 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-1986a7d7-a872-44e0-bd6b-c2740f64a579 req-7e73284b-ad19-4392-a2b0-5064b422f8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1b0372-60fe-4345-9668-12276af08fda", "name": "network-vif-deleted", "tag": "3fba9807-20fe-41d5-8c1a-0473403d7805"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:23.412941 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:23.432898 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-1986a7d7-a872-44e0-bd6b-c2740f64a579 req-7e73284b-ad19-4392-a2b0-5064b422f8c9 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:23.433721 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-1986a7d7-a872-44e0-bd6b-c2740f64a579 req-7e73284b-ad19-4392-a2b0-5064b422f8c9 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:23.462864 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-1986a7d7-a872-44e0-bd6b-c2740f64a579 req-7e73284b-ad19-4392-a2b0-5064b422f8c9 service nova] Creating event network-vif-deleted:3fba9807-20fe-41d5-8c1a-0473403d7805 for instance fc1b0372-60fe-4345-9668-12276af08fda on hv-cinder-85070 Jul 21 23:44:23.469565 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-1986a7d7-a872-44e0-bd6b-c2740f64a579 req-7e73284b-ad19-4392-a2b0-5064b422f8c9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302468 Jul 21 23:44:23.471438 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 388/742] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:23.614270 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0fbb6833-9dbc-4982-9323-195c8f7d1d37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:23.615700 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0fbb6833-9dbc-4982-9323-195c8f7d1d37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:23.624748 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0fbb6833-9dbc-4982-9323-195c8f7d1d37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:23.625523 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0fbb6833-9dbc-4982-9323-195c8f7d1d37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:23.626843 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0fbb6833-9dbc-4982-9323-195c8f7d1d37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:23.627580 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0fbb6833-9dbc-4982-9323-195c8f7d1d37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:23.863450 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0fbb6833-9dbc-4982-9323-195c8f7d1d37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:23.878910 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0fbb6833-9dbc-4982-9323-195c8f7d1d37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:23.881903 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0fbb6833-9dbc-4982-9323-195c8f7d1d37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:23.883525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0fbb6833-9dbc-4982-9323-195c8f7d1d37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1739 microversion: 2.20 time: 0.278815 Jul 21 23:44:23.884694 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 355/743] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:23 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:23.894783 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0c1f6e83-1c1e-4747-ba32-0d887e26652d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:23.895678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0c1f6e83-1c1e-4747-ba32-0d887e26652d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:23.909798 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0c1f6e83-1c1e-4747-ba32-0d887e26652d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:23.915681 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0c1f6e83-1c1e-4747-ba32-0d887e26652d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:23.916745 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0c1f6e83-1c1e-4747-ba32-0d887e26652d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:23.917355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0c1f6e83-1c1e-4747-ba32-0d887e26652d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:23.984414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0c1f6e83-1c1e-4747-ba32-0d887e26652d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:23.985130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0c1f6e83-1c1e-4747-ba32-0d887e26652d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:23.985774 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-0c1f6e83-1c1e-4747-ba32-0d887e26652d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lazy-loading 'fault' on Instance uuid fc1b0372-60fe-4345-9668-12276af08fda {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:44:24.139152 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0c1f6e83-1c1e-4747-ba32-0d887e26652d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:24.142847 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:24.162574 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0c1f6e83-1c1e-4747-ba32-0d887e26652d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 200 len: 1230 microversion: 2.1 time: 0.272075 Jul 21 23:44:24.164068 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 389/744] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:23 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 1230 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:24.907768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-60d17c87-2c98-4fa9-9ed0-b9cba0c7c18b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:24.908333 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-60d17c87-2c98-4fa9-9ed0-b9cba0c7c18b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:24.925489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-60d17c87-2c98-4fa9-9ed0-b9cba0c7c18b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:24.925941 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-60d17c87-2c98-4fa9-9ed0-b9cba0c7c18b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:24.926721 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-60d17c87-2c98-4fa9-9ed0-b9cba0c7c18b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:24.927460 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-60d17c87-2c98-4fa9-9ed0-b9cba0c7c18b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:24.969695 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:25.181461 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-60d17c87-2c98-4fa9-9ed0-b9cba0c7c18b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:25.188128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f8560bef-2e84-472b-b8dc-a1cd9ec698aa tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:25.192179 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f8560bef-2e84-472b-b8dc-a1cd9ec698aa tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:25.198001 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-60d17c87-2c98-4fa9-9ed0-b9cba0c7c18b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:25.203964 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-60d17c87-2c98-4fa9-9ed0-b9cba0c7c18b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:25.206090 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-60d17c87-2c98-4fa9-9ed0-b9cba0c7c18b tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1739 microversion: 2.20 time: 0.305903 Jul 21 23:44:25.217155 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8560bef-2e84-472b-b8dc-a1cd9ec698aa tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:25.217155 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8560bef-2e84-472b-b8dc-a1cd9ec698aa tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:25.217155 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8560bef-2e84-472b-b8dc-a1cd9ec698aa tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:25.217155 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f8560bef-2e84-472b-b8dc-a1cd9ec698aa tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:25.217653 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 356/745] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:24 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:25.225675 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-f8560bef-2e84-472b-b8dc-a1cd9ec698aa tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] HTTP exception thrown: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f8560bef-2e84-472b-b8dc-a1cd9ec698aa tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Request method failure captured: Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda HTTP/1.1 Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eQDE4Bn1yVu8ksFRIZBWG5R-YqOf9RgdQBoDwsU44y8eTTeU_CWYGBiTUkd6sacxyPTXC9Tnax0ACzxTFyuNjDPlakcdJvVEe6Lm9TwbVbPCWLouUCte_pIPg91BDb1Nh623cefKvBmm85DXJVLisSRxFRy-rf4q1BX2EBaHWeDJFM Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 44fb74dd337c49a898397e3482e4305d Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-TestVolumeBootPattern-57714340 Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:44:25.227335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44fb74dd337c49a898397e3482e4305d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/44fb74dd337c49a898397e3482e4305d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_44fb74dd337c49a898397e3482e4305d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44fb74dd337c49a898397e3482e4305d"}]}] Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-TestVolumeBootPattern-57714340 Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 44fb74dd337c49a898397e3482e4305d Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-TestVolumeBootPattern-57714340 Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-TestVolumeBootPattern-57714340-project Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 26738ea4f6d54d7d81f1ec5057c237ff Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-TestVolumeBootPattern-57714340-project Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:44:25.228855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'fc1b0372-60fe-4345-9668-12276af08fda'} Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:44:25.229804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:44:25.231905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:44:25.235233 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f8560bef-2e84-472b-b8dc-a1cd9ec698aa tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Returning 404 to user: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:44:25.236281 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f8560bef-2e84-472b-b8dc-a1cd9ec698aa tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 404 len: 111 microversion: 2.1 time: 0.058134 Jul 21 23:44:25.237344 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 390/746] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:25 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:44:25.407392 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-299614992", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1308624493", "security_groups": [{"name": "tempest-secgroup-smoke-311382891"}], "block_device_mapping_v2": [{"uuid": "008decd9-f34d-48fb-b4d8-8d5a6b00ecda", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "090d43b6-0e83-430b-8cf2-7b66d14a91c7"}]}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:25.609108 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] validate_networks() for [('090d43b6-0e83-430b-8cf2-7b66d14a91c7', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:44:26.223922 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-95a54bc1-6a76-436a-8aa1-6a6280767972 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:26.224489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-95a54bc1-6a76-436a-8aa1-6a6280767972 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:26.230940 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95a54bc1-6a76-436a-8aa1-6a6280767972 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:26.232526 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95a54bc1-6a76-436a-8aa1-6a6280767972 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:26.233360 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95a54bc1-6a76-436a-8aa1-6a6280767972 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:26.233800 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95a54bc1-6a76-436a-8aa1-6a6280767972 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:26.271583 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:44:26.272545 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:44:26.273218 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:44:26.273791 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:44:26.274360 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:44:26.299908 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:26.300623 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:26.301647 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:26.302270 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:26.339682 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Getting quotas for project 44fb74dd337c49a898397e3482e4305d. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:44:26.355211 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Getting quotas for user 26738ea4f6d54d7d81f1ec5057c237ff and project 44fb74dd337c49a898397e3482e4305d. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:44:26.480471 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:44:26.483566 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='008decd9-f34d-48fb-b4d8-8d5a6b00ecda',volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:44:26.589818 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-95a54bc1-6a76-436a-8aa1-6a6280767972 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:26.600775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-95a54bc1-6a76-436a-8aa1-6a6280767972 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:26.608889 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-95a54bc1-6a76-436a-8aa1-6a6280767972 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:26.611044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-95a54bc1-6a76-436a-8aa1-6a6280767972 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1739 microversion: 2.20 time: 0.390698 Jul 21 23:44:26.611459 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 391/747] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:26 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:44:26.723297 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f3169873-96ce-40b1-939e-9ab9d7907ada tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.324347 Jul 21 23:44:26.724484 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 357/748] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:44:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:44:26.738419 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d8bc9afc-9844-4f51-8205-07a51c72609a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:26.739037 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d8bc9afc-9844-4f51-8205-07a51c72609a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:26.883141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d8bc9afc-9844-4f51-8205-07a51c72609a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:26.892137 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d8bc9afc-9844-4f51-8205-07a51c72609a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1094 microversion: 2.1 time: 0.161222 Jul 21 23:44:26.893397 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 392/749] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:26 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1094 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:27.638487 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c5452aee-f12b-457f-bda5-b1adc5a26955 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:27.639730 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-c5452aee-f12b-457f-bda5-b1adc5a26955 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:27.661891 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c5452aee-f12b-457f-bda5-b1adc5a26955 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:27.662428 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c5452aee-f12b-457f-bda5-b1adc5a26955 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:27.666822 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c5452aee-f12b-457f-bda5-b1adc5a26955 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:27.667283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c5452aee-f12b-457f-bda5-b1adc5a26955 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:27.912603 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e13231e3-702f-4a44-bbd2-7d713ce7b33d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:27.914182 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e13231e3-702f-4a44-bbd2-7d713ce7b33d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:27.926309 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e13231e3-702f-4a44-bbd2-7d713ce7b33d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:27.940049 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e13231e3-702f-4a44-bbd2-7d713ce7b33d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:27.941110 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e13231e3-702f-4a44-bbd2-7d713ce7b33d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:27.941832 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e13231e3-702f-4a44-bbd2-7d713ce7b33d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:27.971267 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c5452aee-f12b-457f-bda5-b1adc5a26955 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:27.983018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c5452aee-f12b-457f-bda5-b1adc5a26955 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:27.984543 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-c5452aee-f12b-457f-bda5-b1adc5a26955 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:27.990453 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-c5452aee-f12b-457f-bda5-b1adc5a26955 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1739 microversion: 2.20 time: 0.356364 Jul 21 23:44:27.991226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 358/750] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:27 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:28.077904 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e13231e3-702f-4a44-bbd2-7d713ce7b33d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:28.090240 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e13231e3-702f-4a44-bbd2-7d713ce7b33d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1192 microversion: 2.1 time: 0.184057 Jul 21 23:44:28.101253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 393/751] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:27 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1192 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:29.009970 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1cfc1abd-081a-467d-aa96-0899cea35b8f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:29.010600 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1cfc1abd-081a-467d-aa96-0899cea35b8f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:29.013300 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:29.028453 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1cfc1abd-081a-467d-aa96-0899cea35b8f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:29.029645 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1cfc1abd-081a-467d-aa96-0899cea35b8f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:29.030737 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1cfc1abd-081a-467d-aa96-0899cea35b8f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:29.032348 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1cfc1abd-081a-467d-aa96-0899cea35b8f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:29.110439 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fd779835-f9ae-42b3-9a85-082a0eeea60a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:29.111694 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fd779835-f9ae-42b3-9a85-082a0eeea60a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:29.122236 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd779835-f9ae-42b3-9a85-082a0eeea60a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:29.123069 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd779835-f9ae-42b3-9a85-082a0eeea60a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:29.124109 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd779835-f9ae-42b3-9a85-082a0eeea60a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:29.126692 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fd779835-f9ae-42b3-9a85-082a0eeea60a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:29.227027 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-fd779835-f9ae-42b3-9a85-082a0eeea60a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:29.241785 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fd779835-f9ae-42b3-9a85-082a0eeea60a tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1198 microversion: 2.1 time: 0.137761 Jul 21 23:44:29.243068 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 394/752] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:29 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1198 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:29.692189 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1cfc1abd-081a-467d-aa96-0899cea35b8f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:29.707406 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1cfc1abd-081a-467d-aa96-0899cea35b8f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:29.709427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1cfc1abd-081a-467d-aa96-0899cea35b8f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:29.711612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1cfc1abd-081a-467d-aa96-0899cea35b8f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1739 microversion: 2.20 time: 0.705601 Jul 21 23:44:29.714338 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 359/753] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:29 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1739 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:30.259309 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6156ce1d-1d15-4f5f-9ce4-da7b205419da tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:30.259919 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6156ce1d-1d15-4f5f-9ce4-da7b205419da tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:30.270517 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6156ce1d-1d15-4f5f-9ce4-da7b205419da tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:30.276905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6156ce1d-1d15-4f5f-9ce4-da7b205419da tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:30.277849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6156ce1d-1d15-4f5f-9ce4-da7b205419da tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:30.278299 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6156ce1d-1d15-4f5f-9ce4-da7b205419da tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:30.390102 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1c37ca37-bf02-432d-98d0-c1a08c15fd00 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:30.391171 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1c37ca37-bf02-432d-98d0-c1a08c15fd00 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:30.403890 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c37ca37-bf02-432d-98d0-c1a08c15fd00 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:30.405234 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c37ca37-bf02-432d-98d0-c1a08c15fd00 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:30.406209 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c37ca37-bf02-432d-98d0-c1a08c15fd00 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:30.407428 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1c37ca37-bf02-432d-98d0-c1a08c15fd00 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:30.450726 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1c37ca37-bf02-432d-98d0-c1a08c15fd00 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/ips" status: 200 len: 149 microversion: 2.1 time: 0.066149 Jul 21 23:44:30.472963 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 360/754] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 23:44:30 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/ips => generated 149 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:30.734964 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a966c872-11d4-4cbc-be08-afd93870a61a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:30.736179 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-a966c872-11d4-4cbc-be08-afd93870a61a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:30.751268 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a966c872-11d4-4cbc-be08-afd93870a61a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:30.752833 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a966c872-11d4-4cbc-be08-afd93870a61a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:30.753885 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a966c872-11d4-4cbc-be08-afd93870a61a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:30.756057 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a966c872-11d4-4cbc-be08-afd93870a61a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:31.001638 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6156ce1d-1d15-4f5f-9ce4-da7b205419da tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:31.009128 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6156ce1d-1d15-4f5f-9ce4-da7b205419da tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.753595 Jul 21 23:44:31.009727 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 395/755] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:30 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:31.202454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a966c872-11d4-4cbc-be08-afd93870a61a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:31.214905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a966c872-11d4-4cbc-be08-afd93870a61a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:31.219030 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a966c872-11d4-4cbc-be08-afd93870a61a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:31.222616 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a966c872-11d4-4cbc-be08-afd93870a61a tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1739 microversion: 2.20 time: 0.493767 Jul 21 23:44:31.225632 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 361/756] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:30 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1739 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:44:31.941939 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-08c31680-b459-46b9-bafe-a956cc2b9554 req-c9c4ae30-86e1-42e2-842a-564009a891d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d", "tag": "bbd9ba1f-d794-42e2-b153-64ef54f71175"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:31.974710 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-08c31680-b459-46b9-bafe-a956cc2b9554 req-c9c4ae30-86e1-42e2-842a-564009a891d6 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:31.979715 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-08c31680-b459-46b9-bafe-a956cc2b9554 req-c9c4ae30-86e1-42e2-842a-564009a891d6 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:32.025666 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-08c31680-b459-46b9-bafe-a956cc2b9554 req-c9c4ae30-86e1-42e2-842a-564009a891d6 service nova] Creating event network-changed:bbd9ba1f-d794-42e2-b153-64ef54f71175 for instance 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d on hv-cinder-85070 Jul 21 23:44:32.028664 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1068d01b-6ae8-4b31-993d-db20992fba4c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:32.029353 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1068d01b-6ae8-4b31-993d-db20992fba4c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:32.036868 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-08c31680-b459-46b9-bafe-a956cc2b9554 req-c9c4ae30-86e1-42e2-842a-564009a891d6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096002 Jul 21 23:44:32.045406 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1068d01b-6ae8-4b31-993d-db20992fba4c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:32.045862 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 396/757] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:32.046504 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1068d01b-6ae8-4b31-993d-db20992fba4c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:32.047492 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1068d01b-6ae8-4b31-993d-db20992fba4c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:32.049214 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1068d01b-6ae8-4b31-993d-db20992fba4c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:32.194904 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e0730d2f-24c5-4277-b546-c226c6dcf1a3 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be3f3bc9-8f03-4717-ac7d-0640168937b3"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:32.196304 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e0730d2f-24c5-4277-b546-c226c6dcf1a3 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:32.203409 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e0730d2f-24c5-4277-b546-c226c6dcf1a3 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:32.204011 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e0730d2f-24c5-4277-b546-c226c6dcf1a3 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:32.204901 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e0730d2f-24c5-4277-b546-c226c6dcf1a3 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:32.205473 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e0730d2f-24c5-4277-b546-c226c6dcf1a3 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:32.674221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e0730d2f-24c5-4277-b546-c226c6dcf1a3 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "POST /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483628 Jul 21 23:44:32.675630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 397/758] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:44:32 2022] POST /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:44:32.712048 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6dd0e29b-a641-4770-a7e0-223c3857a5f3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:32.719752 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6dd0e29b-a641-4770-a7e0-223c3857a5f3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:32.759774 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dd0e29b-a641-4770-a7e0-223c3857a5f3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:32.786006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dd0e29b-a641-4770-a7e0-223c3857a5f3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:32.812430 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dd0e29b-a641-4770-a7e0-223c3857a5f3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:32.814680 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6dd0e29b-a641-4770-a7e0-223c3857a5f3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:32.825868 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1068d01b-6ae8-4b31-993d-db20992fba4c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:32.851512 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1068d01b-6ae8-4b31-993d-db20992fba4c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.829340 Jul 21 23:44:32.852784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 362/759] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:32 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:33.210063 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6dd0e29b-a641-4770-a7e0-223c3857a5f3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:33.220060 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6dd0e29b-a641-4770-a7e0-223c3857a5f3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:33.221811 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6dd0e29b-a641-4770-a7e0-223c3857a5f3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:33.223276 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6dd0e29b-a641-4770-a7e0-223c3857a5f3 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1721 microversion: 2.20 time: 0.546209 Jul 21 23:44:33.223886 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 398/760] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:32 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1721 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:33.870983 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f4e35a69-d4d9-4577-b850-d2aa34fb6005 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:33.871637 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f4e35a69-d4d9-4577-b850-d2aa34fb6005 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:33.878557 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f4e35a69-d4d9-4577-b850-d2aa34fb6005 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:33.879008 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f4e35a69-d4d9-4577-b850-d2aa34fb6005 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:33.879785 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f4e35a69-d4d9-4577-b850-d2aa34fb6005 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:33.880221 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f4e35a69-d4d9-4577-b850-d2aa34fb6005 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:34.031777 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f4e35a69-d4d9-4577-b850-d2aa34fb6005 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:34.045293 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f4e35a69-d4d9-4577-b850-d2aa34fb6005 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.177963 Jul 21 23:44:34.046328 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 363/761] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:33 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:34.244249 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c7ea61f6-5a56-446e-be3f-9a4e5ef38268 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:34.244903 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c7ea61f6-5a56-446e-be3f-9a4e5ef38268 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:34.255191 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7ea61f6-5a56-446e-be3f-9a4e5ef38268 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:34.255571 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7ea61f6-5a56-446e-be3f-9a4e5ef38268 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:34.259256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7ea61f6-5a56-446e-be3f-9a4e5ef38268 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:34.259761 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7ea61f6-5a56-446e-be3f-9a4e5ef38268 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:34.487780 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c7ea61f6-5a56-446e-be3f-9a4e5ef38268 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:34.498526 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c7ea61f6-5a56-446e-be3f-9a4e5ef38268 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:34.500328 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c7ea61f6-5a56-446e-be3f-9a4e5ef38268 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:34.501790 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c7ea61f6-5a56-446e-be3f-9a4e5ef38268 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1721 microversion: 2.20 time: 0.262310 Jul 21 23:44:34.502688 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 399/762] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:34 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:34.842416 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-23919e40-f880-480e-a21a-a9088d170aa0 req-96303bb8-8779-48fd-bf5a-25632b878f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c3804b-cf30-461e-8f8c-30250027a445", "name": "network-vif-unplugged", "status": "completed", "tag": "dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:34.853875 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-23919e40-f880-480e-a21a-a9088d170aa0 req-96303bb8-8779-48fd-bf5a-25632b878f1e service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:34.856750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-23919e40-f880-480e-a21a-a9088d170aa0 req-96303bb8-8779-48fd-bf5a-25632b878f1e service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:34.873249 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-23919e40-f880-480e-a21a-a9088d170aa0 req-96303bb8-8779-48fd-bf5a-25632b878f1e service nova] Creating event network-vif-unplugged:dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e for instance a8c3804b-cf30-461e-8f8c-30250027a445 on hv-cinder-85070 Jul 21 23:44:34.888660 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-23919e40-f880-480e-a21a-a9088d170aa0 req-96303bb8-8779-48fd-bf5a-25632b878f1e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049284 Jul 21 23:44:34.889555 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 364/763] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:35.065466 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ec717043-c91c-473c-9a4a-9f06358af562 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:35.066265 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ec717043-c91c-473c-9a4a-9f06358af562 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:35.076393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ec717043-c91c-473c-9a4a-9f06358af562 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:35.077591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ec717043-c91c-473c-9a4a-9f06358af562 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:35.078672 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ec717043-c91c-473c-9a4a-9f06358af562 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:35.079266 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ec717043-c91c-473c-9a4a-9f06358af562 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:35.396530 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ec717043-c91c-473c-9a4a-9f06358af562 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:35.409492 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ec717043-c91c-473c-9a4a-9f06358af562 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.348024 Jul 21 23:44:35.422796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 400/764] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:35 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:35.521759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-55ba7a2e-ea28-439c-9e8c-6e35def9404f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:35.522473 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-55ba7a2e-ea28-439c-9e8c-6e35def9404f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:35.532481 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55ba7a2e-ea28-439c-9e8c-6e35def9404f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:35.536311 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55ba7a2e-ea28-439c-9e8c-6e35def9404f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:35.537232 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55ba7a2e-ea28-439c-9e8c-6e35def9404f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:35.537752 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55ba7a2e-ea28-439c-9e8c-6e35def9404f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:35.734535 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-55ba7a2e-ea28-439c-9e8c-6e35def9404f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:35.743722 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-55ba7a2e-ea28-439c-9e8c-6e35def9404f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:35.745248 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-55ba7a2e-ea28-439c-9e8c-6e35def9404f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:35.746459 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-55ba7a2e-ea28-439c-9e8c-6e35def9404f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1664 microversion: 2.20 time: 0.229167 Jul 21 23:44:35.747004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 365/765] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:35 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1664 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:35.765925 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a444fce1-f0be-4a04-8922-531dfb40510f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a618a0c-88f8-4f5b-a646-000612c77fa6"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:35.767069 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a444fce1-f0be-4a04-8922-531dfb40510f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:35.773387 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a444fce1-f0be-4a04-8922-531dfb40510f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:35.773770 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a444fce1-f0be-4a04-8922-531dfb40510f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:35.774541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a444fce1-f0be-4a04-8922-531dfb40510f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:35.774973 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a444fce1-f0be-4a04-8922-531dfb40510f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:36.056236 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-64bd35c1-4225-4b1d-8007-f4bb2ae29d20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Action: 'create', calling method: .version_select at 0x7f7d288eb1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-48017992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfyMA4Bqg9staKcWXtwHbPzRsB5PUef7ItsZKdGye+L0KI7EzANlifeSs+7IHMhbpBRPa/L/IqDKYpf4hgxFXfupvrVBl/763akz5aEe2y/PwzQ36d6atR9E8bFO2MJpA=="}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:36.079589 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-64bd35c1-4225-4b1d-8007-f4bb2ae29d20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Getting quotas for project 46779b270a484e19a7d9ede6406106d2. Resources: {'key_pairs'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:44:36.085648 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-64bd35c1-4225-4b1d-8007-f4bb2ae29d20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Getting quotas for user 974e560b80084538929507528d1ea9de and project 46779b270a484e19a7d9ede6406106d2. Resources: {'key_pairs'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:44:36.119132 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-64bd35c1-4225-4b1d-8007-f4bb2ae29d20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.273443 Jul 21 23:44:36.120216 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 366/766] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 23:44:35 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:36.169992 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a444fce1-f0be-4a04-8922-531dfb40510f tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "POST /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.406549 Jul 21 23:44:36.173402 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 401/767] 10.222.0.57 () {62 vars in 1363 bytes} [Thu Jul 21 23:44:35 2022] POST /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/os-volume_attachments => generated 188 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 23:44:36.319028 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5300cf8b-7651-4ed1-95da-5341e0c16fd1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:36.319523 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5300cf8b-7651-4ed1-95da-5341e0c16fd1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:36.321865 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:36.330588 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5300cf8b-7651-4ed1-95da-5341e0c16fd1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:36.331035 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5300cf8b-7651-4ed1-95da-5341e0c16fd1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:36.331813 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5300cf8b-7651-4ed1-95da-5341e0c16fd1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:36.332241 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5300cf8b-7651-4ed1-95da-5341e0c16fd1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:36.426492 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-afe1558e-be3f-4b1a-adca-97b98f41fd78 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:36.427844 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-afe1558e-be3f-4b1a-adca-97b98f41fd78 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:36.436823 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-afe1558e-be3f-4b1a-adca-97b98f41fd78 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:36.437496 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-afe1558e-be3f-4b1a-adca-97b98f41fd78 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:36.439797 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-afe1558e-be3f-4b1a-adca-97b98f41fd78 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:36.440559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-afe1558e-be3f-4b1a-adca-97b98f41fd78 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:36.623731 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-afe1558e-be3f-4b1a-adca-97b98f41fd78 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:36.636481 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-afe1558e-be3f-4b1a-adca-97b98f41fd78 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.214115 Jul 21 23:44:36.637717 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 402/768] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:36 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:44:36.694270 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5300cf8b-7651-4ed1-95da-5341e0c16fd1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/os-volume_attachments/0a618a0c-88f8-4f5b-a646-000612c77fa6" status: 202 len: 0 microversion: 2.20 time: 0.380027 Jul 21 23:44:36.712209 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 367/769] 10.222.0.57 () {60 vars in 1456 bytes} [Thu Jul 21 23:44:36 2022] DELETE /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/os-volume_attachments/0a618a0c-88f8-4f5b-a646-000612c77fa6 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:44:36.790931 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-51fb44d5-1055-40ba-9a2d-1fee0fcb5c78 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:36.791506 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-51fb44d5-1055-40ba-9a2d-1fee0fcb5c78 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:36.800939 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-51fb44d5-1055-40ba-9a2d-1fee0fcb5c78 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:36.801432 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-51fb44d5-1055-40ba-9a2d-1fee0fcb5c78 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:36.802530 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-51fb44d5-1055-40ba-9a2d-1fee0fcb5c78 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:36.803135 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-51fb44d5-1055-40ba-9a2d-1fee0fcb5c78 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:36.894357 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:36.896570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:36.919461 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-51fb44d5-1055-40ba-9a2d-1fee0fcb5c78 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "POST /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/action" status: 202 len: 0 microversion: 2.20 time: 0.132219 Jul 21 23:44:36.920540 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 403/770] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jul 21 23:44:36 2022] POST /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:44:36.928974 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7ad67d1e-a3e6-4a28-99b6-952a4bda9d90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:36.929715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7ad67d1e-a3e6-4a28-99b6-952a4bda9d90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:36.945389 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7ad67d1e-a3e6-4a28-99b6-952a4bda9d90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:36.946575 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7ad67d1e-a3e6-4a28-99b6-952a4bda9d90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:36.949372 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7ad67d1e-a3e6-4a28-99b6-952a4bda9d90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:36.950082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7ad67d1e-a3e6-4a28-99b6-952a4bda9d90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:37.160798 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7ad67d1e-a3e6-4a28-99b6-952a4bda9d90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:37.174638 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7ad67d1e-a3e6-4a28-99b6-952a4bda9d90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:37.178050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7ad67d1e-a3e6-4a28-99b6-952a4bda9d90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:37.179278 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7ad67d1e-a3e6-4a28-99b6-952a4bda9d90 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1672 microversion: 2.20 time: 0.254951 Jul 21 23:44:37.179837 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 368/771] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:36 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1672 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:37.657847 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-11253a2e-dc27-44d2-8d07-cb4e59589c90 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:37.659140 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-11253a2e-dc27-44d2-8d07-cb4e59589c90 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:37.672168 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11253a2e-dc27-44d2-8d07-cb4e59589c90 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:37.672908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11253a2e-dc27-44d2-8d07-cb4e59589c90 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:37.673769 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11253a2e-dc27-44d2-8d07-cb4e59589c90 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:37.674208 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-11253a2e-dc27-44d2-8d07-cb4e59589c90 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:38.176932 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-11253a2e-dc27-44d2-8d07-cb4e59589c90 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:38.184854 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-11253a2e-dc27-44d2-8d07-cb4e59589c90 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.535181 Jul 21 23:44:38.185464 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 404/772] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:37 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:38.201395 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6e3aa574-a053-4e3c-9c59-a94538ed15b1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:38.202018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6e3aa574-a053-4e3c-9c59-a94538ed15b1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:38.209148 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6e3aa574-a053-4e3c-9c59-a94538ed15b1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:38.209712 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6e3aa574-a053-4e3c-9c59-a94538ed15b1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:38.210746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6e3aa574-a053-4e3c-9c59-a94538ed15b1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:38.211393 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6e3aa574-a053-4e3c-9c59-a94538ed15b1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:38.432907 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6e3aa574-a053-4e3c-9c59-a94538ed15b1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:38.442053 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6e3aa574-a053-4e3c-9c59-a94538ed15b1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:38.443614 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6e3aa574-a053-4e3c-9c59-a94538ed15b1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:38.444824 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6e3aa574-a053-4e3c-9c59-a94538ed15b1 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1672 microversion: 2.20 time: 0.248211 Jul 21 23:44:38.445420 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 369/773] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:38 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:44:39.206751 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-abac4f0f-b14e-4433-9e44-7f15eb874de8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:39.207383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-abac4f0f-b14e-4433-9e44-7f15eb874de8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:39.214133 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-abac4f0f-b14e-4433-9e44-7f15eb874de8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:39.214689 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-abac4f0f-b14e-4433-9e44-7f15eb874de8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:39.216725 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-abac4f0f-b14e-4433-9e44-7f15eb874de8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:39.216846 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-abac4f0f-b14e-4433-9e44-7f15eb874de8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:39.375002 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-abac4f0f-b14e-4433-9e44-7f15eb874de8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:39.385625 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-abac4f0f-b14e-4433-9e44-7f15eb874de8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.182590 Jul 21 23:44:39.390398 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 405/774] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:39 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:39.464468 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f78e8d59-56af-4a3e-9e5f-0b2f69becf37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:39.465094 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f78e8d59-56af-4a3e-9e5f-0b2f69becf37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:39.471781 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f78e8d59-56af-4a3e-9e5f-0b2f69becf37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:39.472235 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f78e8d59-56af-4a3e-9e5f-0b2f69becf37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:39.473062 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f78e8d59-56af-4a3e-9e5f-0b2f69becf37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:39.473528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f78e8d59-56af-4a3e-9e5f-0b2f69becf37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:39.615300 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f78e8d59-56af-4a3e-9e5f-0b2f69becf37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:39.624230 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f78e8d59-56af-4a3e-9e5f-0b2f69becf37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:39.625834 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f78e8d59-56af-4a3e-9e5f-0b2f69becf37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:39.626970 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f78e8d59-56af-4a3e-9e5f-0b2f69becf37 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.167037 Jul 21 23:44:39.627533 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 370/775] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:39 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:40.407011 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ef6786d9-4083-45f6-a774-b29f0da3e78b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:40.407636 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ef6786d9-4083-45f6-a774-b29f0da3e78b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:40.414431 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ef6786d9-4083-45f6-a774-b29f0da3e78b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:40.415064 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ef6786d9-4083-45f6-a774-b29f0da3e78b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:40.415997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ef6786d9-4083-45f6-a774-b29f0da3e78b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:40.419876 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ef6786d9-4083-45f6-a774-b29f0da3e78b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:40.601326 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ef6786d9-4083-45f6-a774-b29f0da3e78b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:40.626357 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ef6786d9-4083-45f6-a774-b29f0da3e78b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.222301 Jul 21 23:44:40.648156 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3554b0cb-13a7-4042-ab73-2dff4c8e8783 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:40.649582 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3554b0cb-13a7-4042-ab73-2dff4c8e8783 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:40.655731 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 406/776] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:40 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:40.658312 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3554b0cb-13a7-4042-ab73-2dff4c8e8783 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:40.659687 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3554b0cb-13a7-4042-ab73-2dff4c8e8783 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:40.667393 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3554b0cb-13a7-4042-ab73-2dff4c8e8783 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:40.668212 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3554b0cb-13a7-4042-ab73-2dff4c8e8783 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:40.872276 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3554b0cb-13a7-4042-ab73-2dff4c8e8783 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:40.882050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3554b0cb-13a7-4042-ab73-2dff4c8e8783 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:40.884253 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3554b0cb-13a7-4042-ab73-2dff4c8e8783 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:40.885463 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3554b0cb-13a7-4042-ab73-2dff4c8e8783 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.243349 Jul 21 23:44:40.886746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 371/777] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:40 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:41.644609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-08f0cac5-f07e-4cb1-9791-ed038fb1dec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:41.646482 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-08f0cac5-f07e-4cb1-9791-ed038fb1dec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:41.657726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-08f0cac5-f07e-4cb1-9791-ed038fb1dec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:41.658190 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-08f0cac5-f07e-4cb1-9791-ed038fb1dec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:41.658973 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-08f0cac5-f07e-4cb1-9791-ed038fb1dec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:41.659636 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-08f0cac5-f07e-4cb1-9791-ed038fb1dec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:41.808892 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-50c45cb6-3ce4-43b9-8925-880263501a28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:41.810963 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-50c45cb6-3ce4-43b9-8925-880263501a28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:41.818354 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-50c45cb6-3ce4-43b9-8925-880263501a28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:41.819160 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-50c45cb6-3ce4-43b9-8925-880263501a28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:41.820164 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-50c45cb6-3ce4-43b9-8925-880263501a28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:41.821151 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-50c45cb6-3ce4-43b9-8925-880263501a28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:41.924812 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-08f0cac5-f07e-4cb1-9791-ed038fb1dec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:41.937743 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-08f0cac5-f07e-4cb1-9791-ed038fb1dec3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.297148 Jul 21 23:44:41.939162 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 407/778] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:41 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:41.944925 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2995b810-1014-4cfd-a887-9ff3d9671624 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:41.945927 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2995b810-1014-4cfd-a887-9ff3d9671624 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:41.959047 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2995b810-1014-4cfd-a887-9ff3d9671624 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:41.960102 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2995b810-1014-4cfd-a887-9ff3d9671624 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:41.961556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2995b810-1014-4cfd-a887-9ff3d9671624 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:41.962302 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2995b810-1014-4cfd-a887-9ff3d9671624 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:41.985270 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.objects.instance [None req-50c45cb6-3ce4-43b9-8925-880263501a28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lazy-loading 'services' on Instance uuid 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 {{(pid=124387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:44:42.112150 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:42.145558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-50c45cb6-3ce4-43b9-8925-880263501a28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments/be3f3bc9-8f03-4717-ac7d-0640168937b3" status: 202 len: 0 microversion: 2.1 time: 0.350440 Jul 21 23:44:42.150736 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 372/779] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:44:41 2022] DELETE /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments/be3f3bc9-8f03-4717-ac7d-0640168937b3 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:44:42.159139 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-77c6efb5-586b-4bfc-9162-5e285b856cae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:42.161226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-77c6efb5-586b-4bfc-9162-5e285b856cae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:42.176070 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-77c6efb5-586b-4bfc-9162-5e285b856cae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:42.176749 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-77c6efb5-586b-4bfc-9162-5e285b856cae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:42.177857 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-77c6efb5-586b-4bfc-9162-5e285b856cae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:42.178792 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-77c6efb5-586b-4bfc-9162-5e285b856cae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:42.206016 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2995b810-1014-4cfd-a887-9ff3d9671624 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:42.224210 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2995b810-1014-4cfd-a887-9ff3d9671624 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:42.229905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2995b810-1014-4cfd-a887-9ff3d9671624 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:42.237041 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-77c6efb5-586b-4bfc-9162-5e285b856cae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084432 Jul 21 23:44:42.240446 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2995b810-1014-4cfd-a887-9ff3d9671624 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.299812 Jul 21 23:44:42.248438 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 373/780] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:44:42 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:42.255959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 408/781] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:41 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:42.959244 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-24695736-ad61-4a5d-86d0-43daff271494 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:42.960459 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-24695736-ad61-4a5d-86d0-43daff271494 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:42.967774 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-24695736-ad61-4a5d-86d0-43daff271494 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:42.968230 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-24695736-ad61-4a5d-86d0-43daff271494 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:42.969350 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-24695736-ad61-4a5d-86d0-43daff271494 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:42.970009 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-24695736-ad61-4a5d-86d0-43daff271494 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:43.165305 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-24695736-ad61-4a5d-86d0-43daff271494 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:43.173435 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-24695736-ad61-4a5d-86d0-43daff271494 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.218024 Jul 21 23:44:43.174127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 374/782] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:42 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:43.251415 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c8ca4e7e-9d5f-4715-9c90-afc462fe458a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:43.252684 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c8ca4e7e-9d5f-4715-9c90-afc462fe458a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:43.269488 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5bd18ef2-90cc-417b-997c-f6c6ef1c72c6 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:43.270620 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5bd18ef2-90cc-417b-997c-f6c6ef1c72c6 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:43.273331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c8ca4e7e-9d5f-4715-9c90-afc462fe458a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:43.274093 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c8ca4e7e-9d5f-4715-9c90-afc462fe458a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:43.275137 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c8ca4e7e-9d5f-4715-9c90-afc462fe458a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:43.275684 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c8ca4e7e-9d5f-4715-9c90-afc462fe458a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:43.276670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5bd18ef2-90cc-417b-997c-f6c6ef1c72c6 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:43.277125 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5bd18ef2-90cc-417b-997c-f6c6ef1c72c6 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:43.278790 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5bd18ef2-90cc-417b-997c-f6c6ef1c72c6 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:43.279423 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5bd18ef2-90cc-417b-997c-f6c6ef1c72c6 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:43.318489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c8ca4e7e-9d5f-4715-9c90-afc462fe458a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071422 Jul 21 23:44:43.319398 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 409/783] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:44:43 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:43.463410 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5bd18ef2-90cc-417b-997c-f6c6ef1c72c6 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:43.473682 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5bd18ef2-90cc-417b-997c-f6c6ef1c72c6 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:43.475341 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5bd18ef2-90cc-417b-997c-f6c6ef1c72c6 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:43.476644 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5bd18ef2-90cc-417b-997c-f6c6ef1c72c6 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.215543 Jul 21 23:44:43.477445 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 375/784] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:43 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:44.190610 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-56f5a16d-47d1-4a18-a2bb-0dc97429005e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:44.191225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-56f5a16d-47d1-4a18-a2bb-0dc97429005e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:44.197420 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56f5a16d-47d1-4a18-a2bb-0dc97429005e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:44.197894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56f5a16d-47d1-4a18-a2bb-0dc97429005e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:44.198658 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56f5a16d-47d1-4a18-a2bb-0dc97429005e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:44.199154 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-56f5a16d-47d1-4a18-a2bb-0dc97429005e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:44.331573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9c4e6a67-2b8e-4721-ade2-97038b79919a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:44.333921 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9c4e6a67-2b8e-4721-ade2-97038b79919a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:44.342929 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9c4e6a67-2b8e-4721-ade2-97038b79919a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:44.343728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9c4e6a67-2b8e-4721-ade2-97038b79919a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:44.344702 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9c4e6a67-2b8e-4721-ade2-97038b79919a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:44.347465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9c4e6a67-2b8e-4721-ade2-97038b79919a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:44.369221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-56f5a16d-47d1-4a18-a2bb-0dc97429005e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:44.383526 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-56f5a16d-47d1-4a18-a2bb-0dc97429005e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.196709 Jul 21 23:44:44.391938 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 410/785] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:44 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:44.433095 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9c4e6a67-2b8e-4721-ade2-97038b79919a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105850 Jul 21 23:44:44.433972 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 376/786] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:44:44 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:44:44.501428 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-e86f133c-52c2-43cc-856b-61902116a69f req-46a7c43d-a330-4ae3-bea8-6996f92fb544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d", "name": "network-vif-plugged", "status": "completed", "tag": "bbd9ba1f-d794-42e2-b153-64ef54f71175"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:44.504136 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-28566ee8-67bf-4fea-b7c1-54d25da626a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:44.504990 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-28566ee8-67bf-4fea-b7c1-54d25da626a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:44.518551 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e86f133c-52c2-43cc-856b-61902116a69f req-46a7c43d-a330-4ae3-bea8-6996f92fb544 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:44.519740 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28566ee8-67bf-4fea-b7c1-54d25da626a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:44.520366 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e86f133c-52c2-43cc-856b-61902116a69f req-46a7c43d-a330-4ae3-bea8-6996f92fb544 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:44.522677 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28566ee8-67bf-4fea-b7c1-54d25da626a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:44.523741 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28566ee8-67bf-4fea-b7c1-54d25da626a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:44.525741 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-28566ee8-67bf-4fea-b7c1-54d25da626a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:44.549946 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-e86f133c-52c2-43cc-856b-61902116a69f req-46a7c43d-a330-4ae3-bea8-6996f92fb544 service nova] Creating event network-vif-plugged:bbd9ba1f-d794-42e2-b153-64ef54f71175 for instance 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d on hv-cinder-85070 Jul 21 23:44:44.554880 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-e86f133c-52c2-43cc-856b-61902116a69f req-46a7c43d-a330-4ae3-bea8-6996f92fb544 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063518 Jul 21 23:44:44.555548 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 411/787] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:44.712467 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-28566ee8-67bf-4fea-b7c1-54d25da626a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:44.723844 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-28566ee8-67bf-4fea-b7c1-54d25da626a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:44.725363 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-28566ee8-67bf-4fea-b7c1-54d25da626a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:44.727235 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-28566ee8-67bf-4fea-b7c1-54d25da626a7 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.232764 Jul 21 23:44:44.727784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 377/788] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:44 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:45.409717 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-17149e9b-f33d-4535-aae8-db0c131c3174 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:45.411170 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-17149e9b-f33d-4535-aae8-db0c131c3174 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:45.418919 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-17149e9b-f33d-4535-aae8-db0c131c3174 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:45.419702 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-17149e9b-f33d-4535-aae8-db0c131c3174 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:45.423335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-17149e9b-f33d-4535-aae8-db0c131c3174 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:45.423922 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-17149e9b-f33d-4535-aae8-db0c131c3174 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:45.446849 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-c972ca4f-b77f-4dc6-880f-1c208deeac26 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:45.447427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-c972ca4f-b77f-4dc6-880f-1c208deeac26 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:45.466111 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c972ca4f-b77f-4dc6-880f-1c208deeac26 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:45.466797 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c972ca4f-b77f-4dc6-880f-1c208deeac26 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:45.467779 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c972ca4f-b77f-4dc6-880f-1c208deeac26 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:45.468372 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-c972ca4f-b77f-4dc6-880f-1c208deeac26 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:45.508802 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-c972ca4f-b77f-4dc6-880f-1c208deeac26 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067453 Jul 21 23:44:45.510044 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 378/789] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:44:45 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:45.608163 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-17149e9b-f33d-4535-aae8-db0c131c3174 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:45.616382 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-17149e9b-f33d-4535-aae8-db0c131c3174 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.211733 Jul 21 23:44:45.616970 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 412/790] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:45 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:45.748250 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f387dadb-76f0-45ca-b1ca-c7909db45ce2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:45.748858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f387dadb-76f0-45ca-b1ca-c7909db45ce2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:45.755018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f387dadb-76f0-45ca-b1ca-c7909db45ce2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:45.755490 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f387dadb-76f0-45ca-b1ca-c7909db45ce2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:45.756251 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f387dadb-76f0-45ca-b1ca-c7909db45ce2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:45.756708 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f387dadb-76f0-45ca-b1ca-c7909db45ce2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:45.919768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f387dadb-76f0-45ca-b1ca-c7909db45ce2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:45.928867 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f387dadb-76f0-45ca-b1ca-c7909db45ce2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:45.930401 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f387dadb-76f0-45ca-b1ca-c7909db45ce2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:45.931625 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f387dadb-76f0-45ca-b1ca-c7909db45ce2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.188261 Jul 21 23:44:45.932296 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 379/791] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:45 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:46.523519 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ba432d85-a024-4701-b652-f7d4bfc39cd2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:46.524489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ba432d85-a024-4701-b652-f7d4bfc39cd2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:46.537880 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba432d85-a024-4701-b652-f7d4bfc39cd2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:46.538342 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba432d85-a024-4701-b652-f7d4bfc39cd2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:46.539136 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba432d85-a024-4701-b652-f7d4bfc39cd2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:46.539571 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ba432d85-a024-4701-b652-f7d4bfc39cd2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:46.578957 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ba432d85-a024-4701-b652-f7d4bfc39cd2 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059473 Jul 21 23:44:46.583068 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 413/792] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:44:46 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:46.635598 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-55f30b7c-e3c9-4568-8bef-f5a07535452b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:46.642079 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-55f30b7c-e3c9-4568-8bef-f5a07535452b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:46.646755 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=10 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:46.651733 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55f30b7c-e3c9-4568-8bef-f5a07535452b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:46.652265 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55f30b7c-e3c9-4568-8bef-f5a07535452b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:46.653475 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55f30b7c-e3c9-4568-8bef-f5a07535452b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:46.654007 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55f30b7c-e3c9-4568-8bef-f5a07535452b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:46.803491 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-55f30b7c-e3c9-4568-8bef-f5a07535452b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:46.813106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-55f30b7c-e3c9-4568-8bef-f5a07535452b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.182245 Jul 21 23:44:46.813960 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 380/793] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:46 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:46.826972 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a3eb439e-ddb3-4f2a-a764-ae1fc480630b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:46.827843 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a3eb439e-ddb3-4f2a-a764-ae1fc480630b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:46.839429 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a3eb439e-ddb3-4f2a-a764-ae1fc480630b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:46.840389 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a3eb439e-ddb3-4f2a-a764-ae1fc480630b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:46.841502 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a3eb439e-ddb3-4f2a-a764-ae1fc480630b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:46.842169 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a3eb439e-ddb3-4f2a-a764-ae1fc480630b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:46.873674 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a3eb439e-ddb3-4f2a-a764-ae1fc480630b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/ips" status: 200 len: 147 microversion: 2.1 time: 0.052245 Jul 21 23:44:46.874686 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 414/794] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 23:44:46 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/ips => generated 147 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:46.951104 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6f6b3fd4-b4de-450f-8587-b9d947080f89 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:46.951816 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6f6b3fd4-b4de-450f-8587-b9d947080f89 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:46.957931 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6f6b3fd4-b4de-450f-8587-b9d947080f89 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:46.958379 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6f6b3fd4-b4de-450f-8587-b9d947080f89 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:46.959187 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6f6b3fd4-b4de-450f-8587-b9d947080f89 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:46.959625 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6f6b3fd4-b4de-450f-8587-b9d947080f89 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:47.139579 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6f6b3fd4-b4de-450f-8587-b9d947080f89 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:47.157339 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6f6b3fd4-b4de-450f-8587-b9d947080f89 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:47.158833 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6f6b3fd4-b4de-450f-8587-b9d947080f89 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:47.160093 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6f6b3fd4-b4de-450f-8587-b9d947080f89 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.213430 Jul 21 23:44:47.161226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 381/795] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:46 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:47.591339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c02c8a33-f833-4976-bbd4-0522ba9090db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:47.592268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c02c8a33-f833-4976-bbd4-0522ba9090db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:47.599080 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c02c8a33-f833-4976-bbd4-0522ba9090db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:47.599871 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c02c8a33-f833-4976-bbd4-0522ba9090db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:47.600875 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c02c8a33-f833-4976-bbd4-0522ba9090db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:47.601578 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c02c8a33-f833-4976-bbd4-0522ba9090db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:47.649843 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c02c8a33-f833-4976-bbd4-0522ba9090db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062822 Jul 21 23:44:47.650491 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 415/796] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:44:47 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:47.831302 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2dc52d6d-f18a-4dd4-b880-09c8d9e43fae tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:47.832420 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2dc52d6d-f18a-4dd4-b880-09c8d9e43fae tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:47.841927 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2dc52d6d-f18a-4dd4-b880-09c8d9e43fae tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:47.842999 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2dc52d6d-f18a-4dd4-b880-09c8d9e43fae tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:47.844098 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2dc52d6d-f18a-4dd4-b880-09c8d9e43fae tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:47.844607 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2dc52d6d-f18a-4dd4-b880-09c8d9e43fae tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:47.992681 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2dc52d6d-f18a-4dd4-b880-09c8d9e43fae tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:48.000888 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2dc52d6d-f18a-4dd4-b880-09c8d9e43fae tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.174110 Jul 21 23:44:48.001482 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 382/797] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:47 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:48.178701 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ca7c65c6-f273-4ccd-a0c8-d3dcd8ae3bce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:48.179306 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ca7c65c6-f273-4ccd-a0c8-d3dcd8ae3bce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:48.185441 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ca7c65c6-f273-4ccd-a0c8-d3dcd8ae3bce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:48.185910 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ca7c65c6-f273-4ccd-a0c8-d3dcd8ae3bce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:48.186653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ca7c65c6-f273-4ccd-a0c8-d3dcd8ae3bce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:48.187086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ca7c65c6-f273-4ccd-a0c8-d3dcd8ae3bce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:48.344283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3b24f95c-ca5b-4b56-8399-7ed8eedc80f2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc46603c-1421-4147-88ae-4cb72446151e"}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:48.345817 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3b24f95c-ca5b-4b56-8399-7ed8eedc80f2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:48.361277 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3b24f95c-ca5b-4b56-8399-7ed8eedc80f2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:48.361975 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3b24f95c-ca5b-4b56-8399-7ed8eedc80f2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:48.362398 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ca7c65c6-f273-4ccd-a0c8-d3dcd8ae3bce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:48.363236 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3b24f95c-ca5b-4b56-8399-7ed8eedc80f2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:48.363978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3b24f95c-ca5b-4b56-8399-7ed8eedc80f2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:48.371320 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ca7c65c6-f273-4ccd-a0c8-d3dcd8ae3bce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:48.373495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ca7c65c6-f273-4ccd-a0c8-d3dcd8ae3bce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:48.374666 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ca7c65c6-f273-4ccd-a0c8-d3dcd8ae3bce tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.199854 Jul 21 23:44:48.375505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 416/798] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:48 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:48.662247 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9b97c9bf-3764-42f5-ae08-93b2f4a18ef0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:48.663161 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9b97c9bf-3764-42f5-ae08-93b2f4a18ef0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:48.671552 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b97c9bf-3764-42f5-ae08-93b2f4a18ef0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:48.671805 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b97c9bf-3764-42f5-ae08-93b2f4a18ef0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:48.672598 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b97c9bf-3764-42f5-ae08-93b2f4a18ef0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:48.673065 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-9b97c9bf-3764-42f5-ae08-93b2f4a18ef0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:48.716760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9b97c9bf-3764-42f5-ae08-93b2f4a18ef0 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058389 Jul 21 23:44:48.717479 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 417/799] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:44:48 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:44:49.018723 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-93fa3e8f-2dd0-4fcb-bc50-77ebde81e40d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:49.019875 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-93fa3e8f-2dd0-4fcb-bc50-77ebde81e40d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:49.027102 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-93fa3e8f-2dd0-4fcb-bc50-77ebde81e40d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:49.027931 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-93fa3e8f-2dd0-4fcb-bc50-77ebde81e40d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:49.029166 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-93fa3e8f-2dd0-4fcb-bc50-77ebde81e40d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:49.030006 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-93fa3e8f-2dd0-4fcb-bc50-77ebde81e40d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:49.184319 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-93fa3e8f-2dd0-4fcb-bc50-77ebde81e40d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:49.192243 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-93fa3e8f-2dd0-4fcb-bc50-77ebde81e40d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.177492 Jul 21 23:44:49.192921 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 418/800] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:49 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:49.392954 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0d5d27d4-4a59-4c38-bd90-dc2e0b189a44 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:49.393567 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0d5d27d4-4a59-4c38-bd90-dc2e0b189a44 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:49.400046 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d5d27d4-4a59-4c38-bd90-dc2e0b189a44 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:49.400489 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d5d27d4-4a59-4c38-bd90-dc2e0b189a44 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:49.401274 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d5d27d4-4a59-4c38-bd90-dc2e0b189a44 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:49.401709 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0d5d27d4-4a59-4c38-bd90-dc2e0b189a44 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:49.544229 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0d5d27d4-4a59-4c38-bd90-dc2e0b189a44 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:49.553858 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0d5d27d4-4a59-4c38-bd90-dc2e0b189a44 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:49.555380 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0d5d27d4-4a59-4c38-bd90-dc2e0b189a44 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:49.556563 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0d5d27d4-4a59-4c38-bd90-dc2e0b189a44 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.167489 Jul 21 23:44:49.557117 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 419/801] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:49 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:44:49.728022 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fab2afdc-aae9-4a80-ba35-8a67c6fe48db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:49.728998 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fab2afdc-aae9-4a80-ba35-8a67c6fe48db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:49.737268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fab2afdc-aae9-4a80-ba35-8a67c6fe48db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:49.737716 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fab2afdc-aae9-4a80-ba35-8a67c6fe48db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:49.742887 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fab2afdc-aae9-4a80-ba35-8a67c6fe48db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:49.743258 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fab2afdc-aae9-4a80-ba35-8a67c6fe48db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:49.787624 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fab2afdc-aae9-4a80-ba35-8a67c6fe48db tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063447 Jul 21 23:44:49.788306 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 420/802] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:44:49 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:44:50.210145 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a114ccab-be55-47da-bab0-f9ef0b15bc98 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:50.210760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a114ccab-be55-47da-bab0-f9ef0b15bc98 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:50.216845 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a114ccab-be55-47da-bab0-f9ef0b15bc98 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:50.217325 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a114ccab-be55-47da-bab0-f9ef0b15bc98 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:50.218096 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a114ccab-be55-47da-bab0-f9ef0b15bc98 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:50.218535 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a114ccab-be55-47da-bab0-f9ef0b15bc98 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:50.237356 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:50.351309 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a114ccab-be55-47da-bab0-f9ef0b15bc98 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:50.359304 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a114ccab-be55-47da-bab0-f9ef0b15bc98 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.153186 Jul 21 23:44:50.359860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 421/803] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:50 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:44:50.576616 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cca50397-3ddd-4568-9254-aeb39e156089 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:50.577231 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cca50397-3ddd-4568-9254-aeb39e156089 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:50.583268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cca50397-3ddd-4568-9254-aeb39e156089 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:50.583716 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cca50397-3ddd-4568-9254-aeb39e156089 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:50.584472 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cca50397-3ddd-4568-9254-aeb39e156089 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:50.584906 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cca50397-3ddd-4568-9254-aeb39e156089 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:50.717820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cca50397-3ddd-4568-9254-aeb39e156089 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:50.725616 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cca50397-3ddd-4568-9254-aeb39e156089 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:50.727105 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-cca50397-3ddd-4568-9254-aeb39e156089 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:50.728240 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cca50397-3ddd-4568-9254-aeb39e156089 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.156121 Jul 21 23:44:50.728840 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 422/804] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:50 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:44:50.799834 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-24272333-412d-4cb3-ac79-ced6267228ae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:50.800752 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-24272333-412d-4cb3-ac79-ced6267228ae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:50.807458 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-24272333-412d-4cb3-ac79-ced6267228ae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:50.807913 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-24272333-412d-4cb3-ac79-ced6267228ae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:50.809559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-24272333-412d-4cb3-ac79-ced6267228ae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:50.810052 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-24272333-412d-4cb3-ac79-ced6267228ae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:50.838430 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-24272333-412d-4cb3-ac79-ced6267228ae tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 Jul 21 23:44:50.839003 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 423/805] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:44:50 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:44:51.203377 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3b24f95c-ca5b-4b56-8399-7ed8eedc80f2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "POST /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.864189 Jul 21 23:44:51.203970 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 383/806] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:44:48 2022] POST /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments => generated 194 bytes in 2866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:51.376309 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5837446e-6618-4c91-8472-177f153360b0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:51.376914 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5837446e-6618-4c91-8472-177f153360b0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:51.382947 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5837446e-6618-4c91-8472-177f153360b0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:51.383396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5837446e-6618-4c91-8472-177f153360b0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:51.384152 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5837446e-6618-4c91-8472-177f153360b0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:51.384589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5837446e-6618-4c91-8472-177f153360b0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:51.518307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5837446e-6618-4c91-8472-177f153360b0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:51.531525 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5837446e-6618-4c91-8472-177f153360b0 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.158583 Jul 21 23:44:51.535142 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 424/807] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:51 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:51.749386 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-79c20898-73f1-4219-bac2-edf599e7fd09 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:51.750069 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-79c20898-73f1-4219-bac2-edf599e7fd09 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:51.756217 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-79c20898-73f1-4219-bac2-edf599e7fd09 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:51.756658 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-79c20898-73f1-4219-bac2-edf599e7fd09 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:51.757439 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-79c20898-73f1-4219-bac2-edf599e7fd09 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:51.757873 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-79c20898-73f1-4219-bac2-edf599e7fd09 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:51.850348 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-97194576-7989-438c-b122-836949b7e8c7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:51.851891 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-97194576-7989-438c-b122-836949b7e8c7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:51.858775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-97194576-7989-438c-b122-836949b7e8c7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:51.859220 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-97194576-7989-438c-b122-836949b7e8c7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:51.859982 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-97194576-7989-438c-b122-836949b7e8c7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:51.860412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-97194576-7989-438c-b122-836949b7e8c7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:51.893525 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-97194576-7989-438c-b122-836949b7e8c7 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047185 Jul 21 23:44:51.894104 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 425/808] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:44:51 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:44:51.907136 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-79c20898-73f1-4219-bac2-edf599e7fd09 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:51.915239 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-79c20898-73f1-4219-bac2-edf599e7fd09 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:51.916790 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-79c20898-73f1-4219-bac2-edf599e7fd09 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:51.918076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-79c20898-73f1-4219-bac2-edf599e7fd09 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.174267 Jul 21 23:44:51.918677 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 384/809] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:51 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:52.547428 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ae28d749-9be6-4ae0-bd01-907c8b50ac04 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:52.548033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ae28d749-9be6-4ae0-bd01-907c8b50ac04 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:52.554089 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae28d749-9be6-4ae0-bd01-907c8b50ac04 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:52.554538 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae28d749-9be6-4ae0-bd01-907c8b50ac04 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:52.555298 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae28d749-9be6-4ae0-bd01-907c8b50ac04 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:52.555732 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ae28d749-9be6-4ae0-bd01-907c8b50ac04 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:52.688573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ae28d749-9be6-4ae0-bd01-907c8b50ac04 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:52.696059 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ae28d749-9be6-4ae0-bd01-907c8b50ac04 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.152493 Jul 21 23:44:52.696612 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 426/810] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:52 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:52.906030 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-cd2fb5bf-65ec-4331-b271-7883be12d5b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:52.907019 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-cd2fb5bf-65ec-4331-b271-7883be12d5b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:52.914029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd2fb5bf-65ec-4331-b271-7883be12d5b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:52.914475 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd2fb5bf-65ec-4331-b271-7883be12d5b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:52.915246 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd2fb5bf-65ec-4331-b271-7883be12d5b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:52.915764 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd2fb5bf-65ec-4331-b271-7883be12d5b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:52.941428 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-14578641-97cb-4ab3-8664-69129a85e447 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:52.942233 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-14578641-97cb-4ab3-8664-69129a85e447 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:52.950622 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-cd2fb5bf-65ec-4331-b271-7883be12d5b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049356 Jul 21 23:44:52.952140 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 385/811] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:44:52 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:44:52.952821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14578641-97cb-4ab3-8664-69129a85e447 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:52.953335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14578641-97cb-4ab3-8664-69129a85e447 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:52.954554 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14578641-97cb-4ab3-8664-69129a85e447 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:52.955145 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-14578641-97cb-4ab3-8664-69129a85e447 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:53.014909 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-cd60426f-681d-4b5f-82f1-520e3154a0b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:53.016049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-cd60426f-681d-4b5f-82f1-520e3154a0b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:53.022606 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd60426f-681d-4b5f-82f1-520e3154a0b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:53.023055 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd60426f-681d-4b5f-82f1-520e3154a0b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:53.023919 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd60426f-681d-4b5f-82f1-520e3154a0b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:53.024353 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd60426f-681d-4b5f-82f1-520e3154a0b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:53.050450 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-cd60426f-681d-4b5f-82f1-520e3154a0b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:44:53.099651 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:53.109978 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-14578641-97cb-4ab3-8664-69129a85e447 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:53.119136 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-14578641-97cb-4ab3-8664-69129a85e447 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:53.120826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-14578641-97cb-4ab3-8664-69129a85e447 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:53.122202 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-14578641-97cb-4ab3-8664-69129a85e447 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.189047 Jul 21 23:44:53.122929 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 427/812] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:52 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:53.138476 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-cd60426f-681d-4b5f-82f1-520e3154a0b8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 204 len: 0 microversion: 2.1 time: 0.126730 Jul 21 23:44:53.139358 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 386/813] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:44:53 2022] DELETE /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 23:44:53.147886 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4c3ac1e0-6717-4506-a354-58e505d4f919 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:53.148504 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4c3ac1e0-6717-4506-a354-58e505d4f919 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:53.155931 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4c3ac1e0-6717-4506-a354-58e505d4f919 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:53.156403 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4c3ac1e0-6717-4506-a354-58e505d4f919 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:53.157175 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4c3ac1e0-6717-4506-a354-58e505d4f919 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:53.157655 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4c3ac1e0-6717-4506-a354-58e505d4f919 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:53.295634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4c3ac1e0-6717-4506-a354-58e505d4f919 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:53.303195 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4c3ac1e0-6717-4506-a354-58e505d4f919 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1680 microversion: 2.1 time: 0.159427 Jul 21 23:44:53.303753 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 428/814] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:53 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:53.714144 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8461cc3b-8786-4fbf-9034-c9aeb2d06075 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:53.714800 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8461cc3b-8786-4fbf-9034-c9aeb2d06075 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:53.721412 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8461cc3b-8786-4fbf-9034-c9aeb2d06075 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:53.721857 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8461cc3b-8786-4fbf-9034-c9aeb2d06075 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:53.722613 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8461cc3b-8786-4fbf-9034-c9aeb2d06075 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:53.723045 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8461cc3b-8786-4fbf-9034-c9aeb2d06075 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:53.858989 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-8461cc3b-8786-4fbf-9034-c9aeb2d06075 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:53.866621 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8461cc3b-8786-4fbf-9034-c9aeb2d06075 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1265 microversion: 2.1 time: 0.156791 Jul 21 23:44:53.867184 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 387/815] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:53 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:53.969017 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1780679960", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-48017992", "security_groups": [{"name": "tempest-secgroup-smoke-1376580389"}], "networks": [{"uuid": "98a15ecd-b146-4c11-8304-f18b0d0cbc4f"}], "block_device_mapping_v2": [{"uuid": "b644fdf8-b719-4b95-80ed-7c89162d6f83", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:53.977502 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=88 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:54.082631 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] validate_networks() for [('98a15ecd-b146-4c11-8304-f18b0d0cbc4f', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:44:54.139898 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-bfa27b76-d1f8-4bc4-a8b2-81d6221be8bd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:54.140617 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-bfa27b76-d1f8-4bc4-a8b2-81d6221be8bd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:54.146661 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bfa27b76-d1f8-4bc4-a8b2-81d6221be8bd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:54.147112 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bfa27b76-d1f8-4bc4-a8b2-81d6221be8bd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:54.147876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bfa27b76-d1f8-4bc4-a8b2-81d6221be8bd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:54.148314 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-bfa27b76-d1f8-4bc4-a8b2-81d6221be8bd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:54.281117 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bfa27b76-d1f8-4bc4-a8b2-81d6221be8bd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:54.289213 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bfa27b76-d1f8-4bc4-a8b2-81d6221be8bd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:54.290750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-bfa27b76-d1f8-4bc4-a8b2-81d6221be8bd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:54.291906 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-bfa27b76-d1f8-4bc4-a8b2-81d6221be8bd tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.156028 Jul 21 23:44:54.292657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 388/816] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:54 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:44:54.321031 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d003f9a8-64d4-4457-b1ae-2742ff401172 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:54.321935 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d003f9a8-64d4-4457-b1ae-2742ff401172 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:54.328932 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d003f9a8-64d4-4457-b1ae-2742ff401172 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:54.329574 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d003f9a8-64d4-4457-b1ae-2742ff401172 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:54.330540 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d003f9a8-64d4-4457-b1ae-2742ff401172 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:54.331061 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d003f9a8-64d4-4457-b1ae-2742ff401172 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:54.506351 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:44:54.506768 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:44:54.507237 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:44:54.508163 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:44:54.508767 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:44:54.510601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d003f9a8-64d4-4457-b1ae-2742ff401172 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:54.518780 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:54.519151 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d003f9a8-64d4-4457-b1ae-2742ff401172 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1680 microversion: 2.1 time: 0.201857 Jul 21 23:44:54.519301 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:54.519851 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 389/817] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:54 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:54.520085 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:54.520822 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:54.540308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Getting quotas for project 46779b270a484e19a7d9ede6406106d2. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:44:54.544736 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Getting quotas for user 974e560b80084538929507528d1ea9de and project 46779b270a484e19a7d9ede6406106d2. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:44:54.600337 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:44:54.602432 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b644fdf8-b719-4b95-80ed-7c89162d6f83',volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:44:54.737383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f931ade9-1a87-44a5-80e8-166b110bd1e3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772740 Jul 21 23:44:54.743304 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 429/818] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:44:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:44:54.750137 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-df64e04c-d716-48f2-8548-39d599dbbb27 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:54.752043 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-df64e04c-d716-48f2-8548-39d599dbbb27 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:54.858145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-df64e04c-d716-48f2-8548-39d599dbbb27 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:54.865214 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-df64e04c-d716-48f2-8548-39d599dbbb27 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1087 microversion: 2.1 time: 0.120027 Jul 21 23:44:54.875692 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 390/819] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:54 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1087 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:44:54.888552 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-76da8ba0-5fbe-49fd-9a18-9744e7ee46bf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:54.889281 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-76da8ba0-5fbe-49fd-9a18-9744e7ee46bf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:54.899416 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76da8ba0-5fbe-49fd-9a18-9744e7ee46bf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:54.900297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76da8ba0-5fbe-49fd-9a18-9744e7ee46bf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:54.901260 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76da8ba0-5fbe-49fd-9a18-9744e7ee46bf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:54.901722 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-76da8ba0-5fbe-49fd-9a18-9744e7ee46bf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:55.061534 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-76da8ba0-5fbe-49fd-9a18-9744e7ee46bf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:55.069488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-76da8ba0-5fbe-49fd-9a18-9744e7ee46bf tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1452 microversion: 2.1 time: 0.188332 Jul 21 23:44:55.081632 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 430/820] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:54 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1452 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:44:55.086999 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-cba6e27d-7aa8-46e0-8167-bf16326257dd tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:55.087614 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-cba6e27d-7aa8-46e0-8167-bf16326257dd tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:55.098309 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cba6e27d-7aa8-46e0-8167-bf16326257dd tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:55.099033 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cba6e27d-7aa8-46e0-8167-bf16326257dd tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:55.099994 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cba6e27d-7aa8-46e0-8167-bf16326257dd tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:55.100604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cba6e27d-7aa8-46e0-8167-bf16326257dd tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:55.311846 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5d2c1edc-4a0f-4de2-940e-3190dd57b7ae tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:55.312886 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5d2c1edc-4a0f-4de2-940e-3190dd57b7ae tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:55.319138 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d2c1edc-4a0f-4de2-940e-3190dd57b7ae tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:55.319692 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d2c1edc-4a0f-4de2-940e-3190dd57b7ae tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:55.320558 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d2c1edc-4a0f-4de2-940e-3190dd57b7ae tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:55.321066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5d2c1edc-4a0f-4de2-940e-3190dd57b7ae tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:55.350936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cba6e27d-7aa8-46e0-8167-bf16326257dd tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:55.358720 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-cba6e27d-7aa8-46e0-8167-bf16326257dd tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1452 microversion: 2.1 time: 0.275485 Jul 21 23:44:55.359913 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 391/821] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:55 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1452 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:55.510563 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5d2c1edc-4a0f-4de2-940e-3190dd57b7ae tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:55.519459 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5d2c1edc-4a0f-4de2-940e-3190dd57b7ae tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:55.521019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5d2c1edc-4a0f-4de2-940e-3190dd57b7ae tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:55.522199 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5d2c1edc-4a0f-4de2-940e-3190dd57b7ae tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.215090 Jul 21 23:44:55.522841 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 431/822] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:55 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:44:55.535905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-e264cb1e-c9ed-4ca6-9f45-107483771bad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:55.536533 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-e264cb1e-c9ed-4ca6-9f45-107483771bad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:55.542743 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e264cb1e-c9ed-4ca6-9f45-107483771bad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:55.543172 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e264cb1e-c9ed-4ca6-9f45-107483771bad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:55.544799 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e264cb1e-c9ed-4ca6-9f45-107483771bad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:55.545481 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-e264cb1e-c9ed-4ca6-9f45-107483771bad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:55.848431 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-e264cb1e-c9ed-4ca6-9f45-107483771bad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:55.855858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-e264cb1e-c9ed-4ca6-9f45-107483771bad tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1680 microversion: 2.1 time: 0.323846 Jul 21 23:44:55.856941 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 392/823] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:55 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1680 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:55.883323 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-37894f92-bede-4f35-8820-67c0bb519df7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:55.883993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-37894f92-bede-4f35-8820-67c0bb519df7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:55.891371 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37894f92-bede-4f35-8820-67c0bb519df7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:55.892203 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37894f92-bede-4f35-8820-67c0bb519df7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:55.893036 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37894f92-bede-4f35-8820-67c0bb519df7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:55.893428 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37894f92-bede-4f35-8820-67c0bb519df7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:55.966541 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-37894f92-bede-4f35-8820-67c0bb519df7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:55.974065 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-37894f92-bede-4f35-8820-67c0bb519df7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1203 microversion: 2.1 time: 0.095076 Jul 21 23:44:55.974633 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 432/824] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:55 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1203 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:56.423383 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-b8f6948e-88a3-4458-9811-b4110065c096 req-ac5acde0-0e08-41c2-b47c-e859443eebfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c3804b-cf30-461e-8f8c-30250027a445", "name": "network-vif-plugged", "status": "completed", "tag": "dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:56.432093 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-b8f6948e-88a3-4458-9811-b4110065c096 req-ac5acde0-0e08-41c2-b47c-e859443eebfe service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:56.432844 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-b8f6948e-88a3-4458-9811-b4110065c096 req-ac5acde0-0e08-41c2-b47c-e859443eebfe service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:56.445883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-b8f6948e-88a3-4458-9811-b4110065c096 req-ac5acde0-0e08-41c2-b47c-e859443eebfe service nova] Creating event network-vif-plugged:dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e for instance a8c3804b-cf30-461e-8f8c-30250027a445 on hv-cinder-85070 Jul 21 23:44:56.452175 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-b8f6948e-88a3-4458-9811-b4110065c096 req-ac5acde0-0e08-41c2-b47c-e859443eebfe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032334 Jul 21 23:44:56.452995 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 393/825] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:56.542602 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0704ccec-ee3b-43d4-898d-2575117a4398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:56.543402 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0704ccec-ee3b-43d4-898d-2575117a4398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:56.555775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0704ccec-ee3b-43d4-898d-2575117a4398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:56.556792 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0704ccec-ee3b-43d4-898d-2575117a4398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:56.558015 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0704ccec-ee3b-43d4-898d-2575117a4398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:56.558749 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0704ccec-ee3b-43d4-898d-2575117a4398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:56.759259 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0704ccec-ee3b-43d4-898d-2575117a4398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:56.768371 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0704ccec-ee3b-43d4-898d-2575117a4398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:56.769974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0704ccec-ee3b-43d4-898d-2575117a4398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:56.771174 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0704ccec-ee3b-43d4-898d-2575117a4398 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.233886 Jul 21 23:44:56.771726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 433/826] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:56 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:56.805226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-5fe83baf-7fa7-4e0d-b2d2-779458942ac7 req-862374d0-fcb9-4582-b28f-af2bf32f2f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57dcf8f0-0e4e-4842-863d-bc83a31fa4f0", "name": "network-vif-deleted", "tag": "cd4fc162-7a71-42e5-b8e5-4f425626f386"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:56.818132 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-5fe83baf-7fa7-4e0d-b2d2-779458942ac7 req-862374d0-fcb9-4582-b28f-af2bf32f2f34 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:56.818886 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-5fe83baf-7fa7-4e0d-b2d2-779458942ac7 req-862374d0-fcb9-4582-b28f-af2bf32f2f34 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:56.832742 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-5fe83baf-7fa7-4e0d-b2d2-779458942ac7 req-862374d0-fcb9-4582-b28f-af2bf32f2f34 service nova] Creating event network-vif-deleted:cd4fc162-7a71-42e5-b8e5-4f425626f386 for instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 on hv-cinder-85070 Jul 21 23:44:56.838841 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-5fe83baf-7fa7-4e0d-b2d2-779458942ac7 req-862374d0-fcb9-4582-b28f-af2bf32f2f34 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038670 Jul 21 23:44:56.840050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 394/827] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:56.876776 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7ab836e3-0d1a-4a79-a79f-96c41e68ec28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:56.877866 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7ab836e3-0d1a-4a79-a79f-96c41e68ec28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:56.886939 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ab836e3-0d1a-4a79-a79f-96c41e68ec28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:56.887897 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ab836e3-0d1a-4a79-a79f-96c41e68ec28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:56.898073 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ab836e3-0d1a-4a79-a79f-96c41e68ec28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:56.898742 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ab836e3-0d1a-4a79-a79f-96c41e68ec28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:56.950452 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ab836e3-0d1a-4a79-a79f-96c41e68ec28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:56.951100 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7ab836e3-0d1a-4a79-a79f-96c41e68ec28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:56.952170 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-7ab836e3-0d1a-4a79-a79f-96c41e68ec28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lazy-loading 'fault' on Instance uuid 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:44:56.992836 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-87fdc680-4bd7-459a-a419-c613e3b25a80 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:56.994752 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-87fdc680-4bd7-459a-a419-c613e3b25a80 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:57.004430 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-7ab836e3-0d1a-4a79-a79f-96c41e68ec28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88237c0f4ae7a31fbaaddbb2d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4faed5bed7450da8122eeb77459f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:57.005023 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-87fdc680-4bd7-459a-a419-c613e3b25a80 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:57.005666 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-87fdc680-4bd7-459a-a419-c613e3b25a80 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:57.007041 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-87fdc680-4bd7-459a-a419-c613e3b25a80 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:57.007656 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-87fdc680-4bd7-459a-a419-c613e3b25a80 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:57.015351 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7ab836e3-0d1a-4a79-a79f-96c41e68ec28 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 200 len: 1330 microversion: 2.1 time: 0.144157 Jul 21 23:44:57.016063 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 434/828] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:56 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 1330 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:57.300259 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-87fdc680-4bd7-459a-a419-c613e3b25a80 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:57.310173 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-87fdc680-4bd7-459a-a419-c613e3b25a80 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1203 microversion: 2.1 time: 0.321992 Jul 21 23:44:57.310848 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 395/829] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:56 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1203 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:57.789775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0a19c364-5a05-4ed7-9e46-9abb6ffd5cee tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:57.790511 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0a19c364-5a05-4ed7-9e46-9abb6ffd5cee tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:57.799776 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a19c364-5a05-4ed7-9e46-9abb6ffd5cee tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:57.800328 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a19c364-5a05-4ed7-9e46-9abb6ffd5cee tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:57.802734 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a19c364-5a05-4ed7-9e46-9abb6ffd5cee tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:57.803868 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0a19c364-5a05-4ed7-9e46-9abb6ffd5cee tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:57.973820 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0a19c364-5a05-4ed7-9e46-9abb6ffd5cee tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:57.984436 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0a19c364-5a05-4ed7-9e46-9abb6ffd5cee tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:57.986155 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0a19c364-5a05-4ed7-9e46-9abb6ffd5cee tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:57.987484 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0a19c364-5a05-4ed7-9e46-9abb6ffd5cee tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.201785 Jul 21 23:44:57.988316 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 435/830] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:57 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:58.032516 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f853c356-bf50-4b9d-9ab5-50c0554f7763 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:58.033135 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f853c356-bf50-4b9d-9ab5-50c0554f7763 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:58.042628 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f853c356-bf50-4b9d-9ab5-50c0554f7763 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:58.042961 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f853c356-bf50-4b9d-9ab5-50c0554f7763 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:58.044391 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f853c356-bf50-4b9d-9ab5-50c0554f7763 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:58.044836 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f853c356-bf50-4b9d-9ab5-50c0554f7763 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:58.061082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-f853c356-bf50-4b9d-9ab5-50c0554f7763 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f853c356-bf50-4b9d-9ab5-50c0554f7763 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 HTTP/1.1 Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:44:58.062810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:58.064573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': '57dcf8f0-0e4e-4842-863d-bc83a31fa4f0'} Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:44:58.065539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:58.067092 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:44:58.069892 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f853c356-bf50-4b9d-9ab5-50c0554f7763 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:44:58.069892 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f853c356-bf50-4b9d-9ab5-50c0554f7763 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 404 len: 111 microversion: 2.1 time: 0.036271 Jul 21 23:44:58.069892 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 396/831] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:58 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:44:58.079752 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f0f2a067-68d5-40ec-8032-9faa14539eaf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '.version_select at 0x7f7d289fa670>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:58.103035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f0f2a067-68d5-40ec-8032-9faa14539eaf tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777222530" status: 202 len: 0 microversion: 2.1 time: 0.028678 Jul 21 23:44:58.107554 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 436/832] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jul 21 23:44:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777222530 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:44:58.328322 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8d54f831-fe78-450c-95fe-21dc72e0eca6 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:58.328930 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8d54f831-fe78-450c-95fe-21dc72e0eca6 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:58.336528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8d54f831-fe78-450c-95fe-21dc72e0eca6 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:58.336995 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8d54f831-fe78-450c-95fe-21dc72e0eca6 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:58.337841 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8d54f831-fe78-450c-95fe-21dc72e0eca6 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:58.338998 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8d54f831-fe78-450c-95fe-21dc72e0eca6 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:58.632797 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-8d54f831-fe78-450c-95fe-21dc72e0eca6 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:58.640524 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8d54f831-fe78-450c-95fe-21dc72e0eca6 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1271 microversion: 2.1 time: 0.317170 Jul 21 23:44:58.645418 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 397/833] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:58 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1271 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:59.008411 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-62050044-e273-4823-b1bc-6978a2015bbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:59.010117 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-62050044-e273-4823-b1bc-6978a2015bbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:59.019892 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62050044-e273-4823-b1bc-6978a2015bbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:59.020726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62050044-e273-4823-b1bc-6978a2015bbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:59.023385 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62050044-e273-4823-b1bc-6978a2015bbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:59.024034 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-62050044-e273-4823-b1bc-6978a2015bbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:59.222180 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-62050044-e273-4823-b1bc-6978a2015bbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:59.245950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-62050044-e273-4823-b1bc-6978a2015bbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:59.249845 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-62050044-e273-4823-b1bc-6978a2015bbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:59.252723 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-62050044-e273-4823-b1bc-6978a2015bbf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1730 microversion: 2.20 time: 0.247747 Jul 21 23:44:59.254239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 437/834] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:44:59 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:44:59.369400 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-f2cc1f99-6f14-4cf1-ad30-39eaf0589683 req-2e015e10-062a-4ee8-be4a-dddc97518c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cff7cce-773f-4500-af5d-a369509ca64f", "tag": "55de6435-1bbb-4a44-ae52-c711d06bfe75"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:44:59.406973 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:59.414625 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-f2cc1f99-6f14-4cf1-ad30-39eaf0589683 req-2e015e10-062a-4ee8-be4a-dddc97518c73 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:59.414858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-f2cc1f99-6f14-4cf1-ad30-39eaf0589683 req-2e015e10-062a-4ee8-be4a-dddc97518c73 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:59.437268 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-f2cc1f99-6f14-4cf1-ad30-39eaf0589683 req-2e015e10-062a-4ee8-be4a-dddc97518c73 service nova] Creating event network-changed:55de6435-1bbb-4a44-ae52-c711d06bfe75 for instance 3cff7cce-773f-4500-af5d-a369509ca64f on hv-cinder-85070 Jul 21 23:44:59.442489 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-f2cc1f99-6f14-4cf1-ad30-39eaf0589683 req-2e015e10-062a-4ee8-be4a-dddc97518c73 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080845 Jul 21 23:44:59.443620 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 398/835] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:44:59.662023 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c5798941-ef1a-4eb7-93ed-678180b44b0d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:59.662641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c5798941-ef1a-4eb7-93ed-678180b44b0d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:59.668605 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c5798941-ef1a-4eb7-93ed-678180b44b0d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:59.669358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c5798941-ef1a-4eb7-93ed-678180b44b0d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:59.670345 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c5798941-ef1a-4eb7-93ed-678180b44b0d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:59.670783 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c5798941-ef1a-4eb7-93ed-678180b44b0d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:59.812221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c5798941-ef1a-4eb7-93ed-678180b44b0d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:44:59.820369 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c5798941-ef1a-4eb7-93ed-678180b44b0d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1271 microversion: 2.1 time: 0.162110 Jul 21 23:44:59.821240 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 438/836] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:59 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:44:59.932103 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9bb5ded6-5ad5-4d8a-b11f-0bb31dedcc4a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:59.932675 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9bb5ded6-5ad5-4d8a-b11f-0bb31dedcc4a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:59.939667 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9bb5ded6-5ad5-4d8a-b11f-0bb31dedcc4a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:59.940106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9bb5ded6-5ad5-4d8a-b11f-0bb31dedcc4a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:59.940866 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9bb5ded6-5ad5-4d8a-b11f-0bb31dedcc4a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:59.941328 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9bb5ded6-5ad5-4d8a-b11f-0bb31dedcc4a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:59.955573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-9bb5ded6-5ad5-4d8a-b11f-0bb31dedcc4a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9bb5ded6-5ad5-4d8a-b11f-0bb31dedcc4a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: DELETE /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 HTTP/1.1 Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:44:59.957231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:59.958750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': '57dcf8f0-0e4e-4842-863d-bc83a31fa4f0'} Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:44:59.962465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:59.963880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:44:59.965327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9bb5ded6-5ad5-4d8a-b11f-0bb31dedcc4a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:44:59.965327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9bb5ded6-5ad5-4d8a-b11f-0bb31dedcc4a tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 404 len: 111 microversion: 2.1 time: 0.030691 Jul 21 23:44:59.965327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 399/837] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:44:59 2022] DELETE /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:44:59.971118 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-259cfe26-e274-4be4-8146-063bbba7e1c1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:44:59.971724 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-259cfe26-e274-4be4-8146-063bbba7e1c1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:44:59.977690 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-259cfe26-e274-4be4-8146-063bbba7e1c1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:59.978130 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-259cfe26-e274-4be4-8146-063bbba7e1c1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:59.978880 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-259cfe26-e274-4be4-8146-063bbba7e1c1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:44:59.979309 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-259cfe26-e274-4be4-8146-063bbba7e1c1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:44:59.992929 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-259cfe26-e274-4be4-8146-063bbba7e1c1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-259cfe26-e274-4be4-8146-063bbba7e1c1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 HTTP/1.1 Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:44:59.994589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:59.995934 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '57dcf8f0-0e4e-4842-863d-bc83a31fa4f0'} Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:44:59.997331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. Jul 21 23:44:59.999358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:00.001964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-259cfe26-e274-4be4-8146-063bbba7e1c1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance 57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:00.001964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-259cfe26-e274-4be4-8146-063bbba7e1c1 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0" status: 404 len: 111 microversion: 2.1 time: 0.028619 Jul 21 23:45:00.001964 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 439/838] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:44:59 2022] GET /compute/v2.1/servers/57dcf8f0-0e4e-4842-863d-bc83a31fa4f0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:00.273749 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6a06fbbe-6376-454e-9ce7-448f3eb42302 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:00.274730 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6a06fbbe-6376-454e-9ce7-448f3eb42302 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:00.291435 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6a06fbbe-6376-454e-9ce7-448f3eb42302 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:00.293228 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6a06fbbe-6376-454e-9ce7-448f3eb42302 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:00.294631 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6a06fbbe-6376-454e-9ce7-448f3eb42302 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:00.295135 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6a06fbbe-6376-454e-9ce7-448f3eb42302 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:00.469587 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6a06fbbe-6376-454e-9ce7-448f3eb42302 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:00.477785 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6a06fbbe-6376-454e-9ce7-448f3eb42302 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:00.479287 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6a06fbbe-6376-454e-9ce7-448f3eb42302 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:00.480454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6a06fbbe-6376-454e-9ce7-448f3eb42302 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1717 microversion: 2.20 time: 0.210908 Jul 21 23:45:00.481761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 400/839] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:45:00 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1717 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:45:00.845354 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a4dee2b6-c911-4e78-a308-afcb0440025c tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:00.847483 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a4dee2b6-c911-4e78-a308-afcb0440025c tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:00.855380 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a4dee2b6-c911-4e78-a308-afcb0440025c tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:00.858818 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a4dee2b6-c911-4e78-a308-afcb0440025c tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:00.859821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a4dee2b6-c911-4e78-a308-afcb0440025c tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:00.860470 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a4dee2b6-c911-4e78-a308-afcb0440025c tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:00.865108 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=100 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:00.900848 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3c8bdab5-5865-4e24-8044-a1128807b077 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:00.902290 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3c8bdab5-5865-4e24-8044-a1128807b077 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:00.912438 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3c8bdab5-5865-4e24-8044-a1128807b077 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:00.913248 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3c8bdab5-5865-4e24-8044-a1128807b077 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:00.914181 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3c8bdab5-5865-4e24-8044-a1128807b077 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:00.914775 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3c8bdab5-5865-4e24-8044-a1128807b077 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:00.947170 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3c8bdab5-5865-4e24-8044-a1128807b077 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051289 Jul 21 23:45:00.947763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 401/840] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:45:00 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:45:00.958348 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4205c281-2a89-41f1-9980-51c4dc3e2ba7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:00.959117 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4205c281-2a89-41f1-9980-51c4dc3e2ba7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:00.965142 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4205c281-2a89-41f1-9980-51c4dc3e2ba7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:00.966468 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4205c281-2a89-41f1-9980-51c4dc3e2ba7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:00.967923 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4205c281-2a89-41f1-9980-51c4dc3e2ba7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:00.968116 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4205c281-2a89-41f1-9980-51c4dc3e2ba7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:01.006397 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4205c281-2a89-41f1-9980-51c4dc3e2ba7 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments/dc46603c-1421-4147-88ae-4cb72446151e" status: 200 len: 194 microversion: 2.1 time: 0.052048 Jul 21 23:45:01.007016 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 402/841] 10.222.0.57 () {58 vars in 1412 bytes} [Thu Jul 21 23:45:00 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments/dc46603c-1421-4147-88ae-4cb72446151e => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:45:01.019433 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a4dee2b6-c911-4e78-a308-afcb0440025c tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:01.032922 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a4dee2b6-c911-4e78-a308-afcb0440025c tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1271 microversion: 2.1 time: 0.192693 Jul 21 23:45:01.034218 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 440/842] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:00 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:01.143804 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4dc5bcc1-508a-4724-a188-664e07a0679b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:01.144583 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4dc5bcc1-508a-4724-a188-664e07a0679b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:01.152278 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4dc5bcc1-508a-4724-a188-664e07a0679b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:01.154413 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4dc5bcc1-508a-4724-a188-664e07a0679b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:01.155580 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4dc5bcc1-508a-4724-a188-664e07a0679b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:01.156442 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4dc5bcc1-508a-4724-a188-664e07a0679b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:01.174388 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-4dc5bcc1-508a-4724-a188-664e07a0679b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4dc5bcc1-508a-4724-a188-664e07a0679b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: DELETE /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d HTTP/1.1 Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:45:01.176326 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:45:01.178145 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': '8d749247-571b-427e-83af-e7b9a7c3894d'} Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:01.179067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:45:01.180520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.181989 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4dc5bcc1-508a-4724-a188-664e07a0679b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:01.182624 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4dc5bcc1-508a-4724-a188-664e07a0679b tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 404 len: 111 microversion: 2.1 time: 0.043204 Jul 21 23:45:01.186698 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 403/843] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:45:01 2022] DELETE /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:01.192337 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-60b835fc-9e6e-4138-87ef-d972c0e953a8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:01.193046 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-60b835fc-9e6e-4138-87ef-d972c0e953a8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 8d749247-571b-427e-83af-e7b9a7c3894d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:01.201305 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-60b835fc-9e6e-4138-87ef-d972c0e953a8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:01.202275 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-60b835fc-9e6e-4138-87ef-d972c0e953a8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:01.203307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-60b835fc-9e6e-4138-87ef-d972c0e953a8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:01.204178 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-60b835fc-9e6e-4138-87ef-d972c0e953a8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:01.223668 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-60b835fc-9e6e-4138-87ef-d972c0e953a8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-60b835fc-9e6e-4138-87ef-d972c0e953a8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d HTTP/1.1 Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:45:01.226649 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:45:01.228224 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '8d749247-571b-427e-83af-e7b9a7c3894d'} Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:01.229030 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. Jul 21 23:45:01.230426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.232335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-60b835fc-9e6e-4138-87ef-d972c0e953a8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance 8d749247-571b-427e-83af-e7b9a7c3894d could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:01.232335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-60b835fc-9e6e-4138-87ef-d972c0e953a8 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d" status: 404 len: 111 microversion: 2.1 time: 0.040013 Jul 21 23:45:01.232335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 441/844] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:01 2022] GET /compute/v2.1/servers/8d749247-571b-427e-83af-e7b9a7c3894d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:01.238295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-39b2f4d4-1906-445d-88a5-a213e20d2a24 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:01.239113 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-39b2f4d4-1906-445d-88a5-a213e20d2a24 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:01.247440 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-39b2f4d4-1906-445d-88a5-a213e20d2a24 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:01.247996 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-39b2f4d4-1906-445d-88a5-a213e20d2a24 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:01.248812 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-39b2f4d4-1906-445d-88a5-a213e20d2a24 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:01.249285 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-39b2f4d4-1906-445d-88a5-a213e20d2a24 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:01.265159 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-39b2f4d4-1906-445d-88a5-a213e20d2a24 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-39b2f4d4-1906-445d-88a5-a213e20d2a24 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: DELETE /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e HTTP/1.1 Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:45:01.266858 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:45:01.268498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': 'd87a95f3-8058-423f-84d8-3bae1a4d760e'} Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:01.269421 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:45:01.270746 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.272406 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-39b2f4d4-1906-445d-88a5-a213e20d2a24 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:01.272406 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-39b2f4d4-1906-445d-88a5-a213e20d2a24 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 404 len: 111 microversion: 2.1 time: 0.034713 Jul 21 23:45:01.272406 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 404/845] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:45:01 2022] DELETE /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:01.277240 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cd9be772-7855-4506-b1db-6cee82085c87 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:01.278830 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-cd9be772-7855-4506-b1db-6cee82085c87 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: d87a95f3-8058-423f-84d8-3bae1a4d760e] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:01.286888 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cd9be772-7855-4506-b1db-6cee82085c87 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:01.287478 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cd9be772-7855-4506-b1db-6cee82085c87 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:01.288490 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cd9be772-7855-4506-b1db-6cee82085c87 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:01.289134 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-cd9be772-7855-4506-b1db-6cee82085c87 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:01.308680 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-cd9be772-7855-4506-b1db-6cee82085c87 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cd9be772-7855-4506-b1db-6cee82085c87 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e HTTP/1.1 Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:45:01.311084 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:45:01.312393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'd87a95f3-8058-423f-84d8-3bae1a4d760e'} Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:01.313111 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. Jul 21 23:45:01.314573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:01.317388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-cd9be772-7855-4506-b1db-6cee82085c87 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance d87a95f3-8058-423f-84d8-3bae1a4d760e could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:01.318621 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-cd9be772-7855-4506-b1db-6cee82085c87 tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e" status: 404 len: 111 microversion: 2.1 time: 0.045138 Jul 21 23:45:01.320569 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 442/846] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:01 2022] GET /compute/v2.1/servers/d87a95f3-8058-423f-84d8-3bae1a4d760e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:01.462439 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-d3152e86-0fd1-4e1d-8bdf-d4cc11c0f2ad req-932c0b7e-c533-4748-8d65-4a10cb55c728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d", "tag": "bbd9ba1f-d794-42e2-b153-64ef54f71175"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:45:01.471777 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-d3152e86-0fd1-4e1d-8bdf-d4cc11c0f2ad req-932c0b7e-c533-4748-8d65-4a10cb55c728 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:01.472342 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-d3152e86-0fd1-4e1d-8bdf-d4cc11c0f2ad req-932c0b7e-c533-4748-8d65-4a10cb55c728 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:01.483601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-d3152e86-0fd1-4e1d-8bdf-d4cc11c0f2ad req-932c0b7e-c533-4748-8d65-4a10cb55c728 service nova] Creating event network-changed:bbd9ba1f-d794-42e2-b153-64ef54f71175 for instance 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d on hv-cinder-85070 Jul 21 23:45:01.488466 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-d3152e86-0fd1-4e1d-8bdf-d4cc11c0f2ad req-932c0b7e-c533-4748-8d65-4a10cb55c728 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030009 Jul 21 23:45:01.489335 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 405/847] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:45:02.050052 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a74b2bc6-82cc-420f-abef-879e700ab7a3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:02.050683 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a74b2bc6-82cc-420f-abef-879e700ab7a3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:02.057089 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a74b2bc6-82cc-420f-abef-879e700ab7a3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:02.057556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a74b2bc6-82cc-420f-abef-879e700ab7a3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:02.058313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a74b2bc6-82cc-420f-abef-879e700ab7a3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:02.058739 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a74b2bc6-82cc-420f-abef-879e700ab7a3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:02.192143 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a74b2bc6-82cc-420f-abef-879e700ab7a3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:02.199626 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a74b2bc6-82cc-420f-abef-879e700ab7a3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1259 microversion: 2.1 time: 0.153480 Jul 21 23:45:02.201393 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 443/848] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:02 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:02.440364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-18b8bafe-ea8f-4d98-9216-14171f641687 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "652af9f0-2418-4f45-b50f-ca766930d442"}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:45:02.441471 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-18b8bafe-ea8f-4d98-9216-14171f641687 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:02.447572 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-18b8bafe-ea8f-4d98-9216-14171f641687 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:02.447997 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-18b8bafe-ea8f-4d98-9216-14171f641687 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:02.448745 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-18b8bafe-ea8f-4d98-9216-14171f641687 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:02.449174 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-18b8bafe-ea8f-4d98-9216-14171f641687 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:02.493871 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-436d741f-b17b-4266-bc45-7d32489ebeea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:02.494454 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-436d741f-b17b-4266-bc45-7d32489ebeea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:02.501491 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-436d741f-b17b-4266-bc45-7d32489ebeea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:02.501941 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-436d741f-b17b-4266-bc45-7d32489ebeea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:02.502735 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-436d741f-b17b-4266-bc45-7d32489ebeea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:02.503171 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-436d741f-b17b-4266-bc45-7d32489ebeea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:02.517479 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-436d741f-b17b-4266-bc45-7d32489ebeea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-436d741f-b17b-4266-bc45-7d32489ebeea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: DELETE /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 HTTP/1.1 Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:45:02.519039 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:45:02.520570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '4395db50-179b-4591-bec9-a738ad477d31'} Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:02.521608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:45:02.522826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:02.524132 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-436d741f-b17b-4266-bc45-7d32489ebeea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:02.524132 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-436d741f-b17b-4266-bc45-7d32489ebeea tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 404 len: 111 microversion: 2.1 time: 0.030446 Jul 21 23:45:02.524132 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 444/849] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:45:02 2022] DELETE /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:02.528963 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-52591466-0f86-421a-bd14-ee0cb3c4f13d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:02.529603 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-52591466-0f86-421a-bd14-ee0cb3c4f13d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] [instance: 4395db50-179b-4591-bec9-a738ad477d31] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:02.536570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-52591466-0f86-421a-bd14-ee0cb3c4f13d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:02.537016 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-52591466-0f86-421a-bd14-ee0cb3c4f13d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:02.537810 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-52591466-0f86-421a-bd14-ee0cb3c4f13d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:02.538925 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-52591466-0f86-421a-bd14-ee0cb3c4f13d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:02.554307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-52591466-0f86-421a-bd14-ee0cb3c4f13d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] HTTP exception thrown: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-52591466-0f86-421a-bd14-ee0cb3c4f13d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Request method failure captured: Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 HTTP/1.1 Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eOG5XQ3kmSVvwTBdrX4KXgVMEmTzwDYB2W7FlhOdyuLwzYB9ZhLgaJFXFtLhE7aVCCjYVwOuK_bfy4QmfR_1ru3Mt6WkQGpROD2qHTD4qQo0qutyGENXk6dr47o5WGchkDiuO0AlH3UaZomOSJveY2gbVxuyOqrIT1_49zpQ1Q5b1M Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:45:02.555877 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fc4faed5bed7450da8122eeb77459f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fc4faed5bed7450da8122eeb77459f3a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fc4faed5bed7450da8122eeb77459f3a"}]}] Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: fc4faed5bed7450da8122eeb77459f3a Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-124014221 Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: c44b88237c0f4ae7a31fbaaddbb2d427 Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeNegativeTest-124014221-project Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:45:02.557606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '4395db50-179b-4591-bec9-a738ad477d31'} Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:02.558474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. Jul 21 23:45:02.560813 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:02.563795 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-52591466-0f86-421a-bd14-ee0cb3c4f13d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] Returning 404 to user: Instance 4395db50-179b-4591-bec9-a738ad477d31 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:02.563795 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-52591466-0f86-421a-bd14-ee0cb3c4f13d tempest-AttachVolumeNegativeTest-124014221 tempest-AttachVolumeNegativeTest-124014221-project] 10.222.0.57 "GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31" status: 404 len: 111 microversion: 2.1 time: 0.032306 Jul 21 23:45:02.563795 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 445/850] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:02 2022] GET /compute/v2.1/servers/4395db50-179b-4591-bec9-a738ad477d31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:02.698443 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-18b8bafe-ea8f-4d98-9216-14171f641687 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "POST /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262177 Jul 21 23:45:02.699189 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 406/851] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:45:02 2022] POST /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:45:03.217905 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e41479ab-fc9c-49b8-a146-57e9efab1ca5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:03.218712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e41479ab-fc9c-49b8-a146-57e9efab1ca5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:03.225295 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e41479ab-fc9c-49b8-a146-57e9efab1ca5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:03.225824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e41479ab-fc9c-49b8-a146-57e9efab1ca5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:03.226673 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e41479ab-fc9c-49b8-a146-57e9efab1ca5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:03.227180 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e41479ab-fc9c-49b8-a146-57e9efab1ca5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:03.428687 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e41479ab-fc9c-49b8-a146-57e9efab1ca5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:03.436577 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e41479ab-fc9c-49b8-a146-57e9efab1ca5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1259 microversion: 2.1 time: 0.222580 Jul 21 23:45:03.437146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 446/852] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:03 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:45:04.456202 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ba3112da-4023-4b88-8961-3b27a8895a62 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:04.457249 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ba3112da-4023-4b88-8961-3b27a8895a62 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:04.464298 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba3112da-4023-4b88-8961-3b27a8895a62 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:04.464877 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba3112da-4023-4b88-8961-3b27a8895a62 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:04.466386 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba3112da-4023-4b88-8961-3b27a8895a62 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:04.466926 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba3112da-4023-4b88-8961-3b27a8895a62 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:04.619259 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ba3112da-4023-4b88-8961-3b27a8895a62 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:04.630743 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ba3112da-4023-4b88-8961-3b27a8895a62 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1259 microversion: 2.1 time: 0.179824 Jul 21 23:45:04.631800 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 407/853] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:04 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:05.647859 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-40fb9fac-aba6-40fd-b235-adeda96083a4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:05.648463 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-40fb9fac-aba6-40fd-b235-adeda96083a4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:05.650845 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:05.651702 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:05.657227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40fb9fac-aba6-40fd-b235-adeda96083a4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:05.657693 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40fb9fac-aba6-40fd-b235-adeda96083a4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:05.658477 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40fb9fac-aba6-40fd-b235-adeda96083a4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:05.658919 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-40fb9fac-aba6-40fd-b235-adeda96083a4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:05.923665 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-40fb9fac-aba6-40fd-b235-adeda96083a4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:05.931623 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-40fb9fac-aba6-40fd-b235-adeda96083a4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1259 microversion: 2.1 time: 0.287622 Jul 21 23:45:05.932381 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 447/854] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:05 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1259 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:06.949246 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0a3667f7-4264-4b91-aa87-4580d60c226a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:06.951556 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0a3667f7-4264-4b91-aa87-4580d60c226a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:06.956825 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:06.959259 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a3667f7-4264-4b91-aa87-4580d60c226a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:06.959681 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a3667f7-4264-4b91-aa87-4580d60c226a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:06.960560 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a3667f7-4264-4b91-aa87-4580d60c226a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:06.960992 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a3667f7-4264-4b91-aa87-4580d60c226a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:06.965794 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:07.105396 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0a3667f7-4264-4b91-aa87-4580d60c226a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:07.114728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0a3667f7-4264-4b91-aa87-4580d60c226a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1259 microversion: 2.1 time: 0.169626 Jul 21 23:45:07.115293 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 408/855] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:06 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:08.131843 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-32e47b95-5fbf-4ce7-b89b-58525bcd9b20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:08.132463 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-32e47b95-5fbf-4ce7-b89b-58525bcd9b20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:08.139595 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-32e47b95-5fbf-4ce7-b89b-58525bcd9b20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:08.140048 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-32e47b95-5fbf-4ce7-b89b-58525bcd9b20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:08.140824 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-32e47b95-5fbf-4ce7-b89b-58525bcd9b20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:08.141289 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-32e47b95-5fbf-4ce7-b89b-58525bcd9b20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:08.339253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-32e47b95-5fbf-4ce7-b89b-58525bcd9b20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:08.348366 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-32e47b95-5fbf-4ce7-b89b-58525bcd9b20 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1259 microversion: 2.1 time: 0.220130 Jul 21 23:45:08.349035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 448/856] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:08 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:09.365106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d4ec673e-59c6-40f4-aadb-723c912dd2ee tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:09.365750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d4ec673e-59c6-40f4-aadb-723c912dd2ee tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:09.373825 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d4ec673e-59c6-40f4-aadb-723c912dd2ee tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:09.375660 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d4ec673e-59c6-40f4-aadb-723c912dd2ee tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:09.376460 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d4ec673e-59c6-40f4-aadb-723c912dd2ee tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:09.376905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d4ec673e-59c6-40f4-aadb-723c912dd2ee tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:09.516151 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d4ec673e-59c6-40f4-aadb-723c912dd2ee tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:09.523608 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d4ec673e-59c6-40f4-aadb-723c912dd2ee tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1259 microversion: 2.1 time: 0.162631 Jul 21 23:45:09.524170 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 409/857] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:09 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:10.422150 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-f4ab4924-5666-4107-8cf5-a027efb433b1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:10.423388 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-f4ab4924-5666-4107-8cf5-a027efb433b1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:10.430594 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f4ab4924-5666-4107-8cf5-a027efb433b1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:10.431249 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f4ab4924-5666-4107-8cf5-a027efb433b1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:10.432900 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f4ab4924-5666-4107-8cf5-a027efb433b1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:10.433564 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-f4ab4924-5666-4107-8cf5-a027efb433b1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:10.470744 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-f4ab4924-5666-4107-8cf5-a027efb433b1 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053852 Jul 21 23:45:10.471359 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 449/858] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:45:10 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:45:10.500299 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-838766f7-f593-46a5-89bf-17ca9c91a397 req-ae500cb3-0b75-4d23-b18c-b0ac55f4708c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cff7cce-773f-4500-af5d-a369509ca64f", "name": "network-vif-plugged", "status": "completed", "tag": "55de6435-1bbb-4a44-ae52-c711d06bfe75"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:45:10.509938 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-838766f7-f593-46a5-89bf-17ca9c91a397 req-ae500cb3-0b75-4d23-b18c-b0ac55f4708c service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:10.510513 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-838766f7-f593-46a5-89bf-17ca9c91a397 req-ae500cb3-0b75-4d23-b18c-b0ac55f4708c service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:10.523821 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-838766f7-f593-46a5-89bf-17ca9c91a397 req-ae500cb3-0b75-4d23-b18c-b0ac55f4708c service nova] Creating event network-vif-plugged:55de6435-1bbb-4a44-ae52-c711d06bfe75 for instance 3cff7cce-773f-4500-af5d-a369509ca64f on hv-cinder-85070 Jul 21 23:45:10.537728 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-838766f7-f593-46a5-89bf-17ca9c91a397 req-ae500cb3-0b75-4d23-b18c-b0ac55f4708c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041930 Jul 21 23:45:10.538856 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 410/859] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:45:10.539920 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-95ae46dd-83d5-4ff7-b061-298d1c3d419e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:10.547508 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-95ae46dd-83d5-4ff7-b061-298d1c3d419e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:10.561757 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95ae46dd-83d5-4ff7-b061-298d1c3d419e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:10.562602 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95ae46dd-83d5-4ff7-b061-298d1c3d419e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:10.563376 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95ae46dd-83d5-4ff7-b061-298d1c3d419e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:10.563804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95ae46dd-83d5-4ff7-b061-298d1c3d419e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:10.628798 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8b0a32c1-c46a-4e28-8858-a72d1cf2838f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:10.629603 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8b0a32c1-c46a-4e28-8858-a72d1cf2838f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:10.637010 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b0a32c1-c46a-4e28-8858-a72d1cf2838f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:10.638850 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b0a32c1-c46a-4e28-8858-a72d1cf2838f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:10.639870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b0a32c1-c46a-4e28-8858-a72d1cf2838f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:10.640450 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b0a32c1-c46a-4e28-8858-a72d1cf2838f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:10.678172 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8b0a32c1-c46a-4e28-8858-a72d1cf2838f tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments/dc46603c-1421-4147-88ae-4cb72446151e" status: 200 len: 194 microversion: 2.1 time: 0.055487 Jul 21 23:45:10.678351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 411/860] 10.222.0.57 () {58 vars in 1412 bytes} [Thu Jul 21 23:45:10 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments/dc46603c-1421-4147-88ae-4cb72446151e => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:45:10.688917 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b60b35b9-40ea-46d8-aa27-78b0061e9e7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:10.698251 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b60b35b9-40ea-46d8-aa27-78b0061e9e7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:10.707031 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b60b35b9-40ea-46d8-aa27-78b0061e9e7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:10.707837 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b60b35b9-40ea-46d8-aa27-78b0061e9e7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:10.708697 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b60b35b9-40ea-46d8-aa27-78b0061e9e7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:10.709982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b60b35b9-40ea-46d8-aa27-78b0061e9e7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:10.787809 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-95ae46dd-83d5-4ff7-b061-298d1c3d419e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:10.797104 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-95ae46dd-83d5-4ff7-b061-298d1c3d419e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1259 microversion: 2.1 time: 0.260921 Jul 21 23:45:10.797719 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 450/861] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:10 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1259 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:10.848029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.objects.instance [None req-b60b35b9-40ea-46d8-aa27-78b0061e9e7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lazy-loading 'services' on Instance uuid c2f95480-1f4a-48a2-8159-c7928d21cdd2 {{(pid=124387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:45:10.925595 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b60b35b9-40ea-46d8-aa27-78b0061e9e7b tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments/dc46603c-1421-4147-88ae-4cb72446151e" status: 202 len: 0 microversion: 2.1 time: 0.241397 Jul 21 23:45:10.926322 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 412/862] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:45:10 2022] DELETE /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments/dc46603c-1421-4147-88ae-4cb72446151e => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:45:11.817208 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-adc0b100-d564-410a-ae16-7c29449a40bb tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:11.818018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-adc0b100-d564-410a-ae16-7c29449a40bb tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:11.827087 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-adc0b100-d564-410a-ae16-7c29449a40bb tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:11.827851 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-adc0b100-d564-410a-ae16-7c29449a40bb tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:11.829014 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-adc0b100-d564-410a-ae16-7c29449a40bb tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:11.829657 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-adc0b100-d564-410a-ae16-7c29449a40bb tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:12.068809 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-adc0b100-d564-410a-ae16-7c29449a40bb tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:12.077247 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-adc0b100-d564-410a-ae16-7c29449a40bb tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1259 microversion: 2.1 time: 0.266248 Jul 21 23:45:12.077913 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 451/863] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:11 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1259 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:45:13.096561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-87d6e869-4738-4a95-9f2a-eb870abc3bfe tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:13.097362 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-87d6e869-4738-4a95-9f2a-eb870abc3bfe tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:13.104477 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-87d6e869-4738-4a95-9f2a-eb870abc3bfe tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:13.104930 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-87d6e869-4738-4a95-9f2a-eb870abc3bfe tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:13.106782 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-87d6e869-4738-4a95-9f2a-eb870abc3bfe tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:13.107195 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c7485128-a7c5-4aba-b1d7-c13368ed7dfc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:13.107693 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c7485128-a7c5-4aba-b1d7-c13368ed7dfc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:13.108304 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-87d6e869-4738-4a95-9f2a-eb870abc3bfe tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:13.114566 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7485128-a7c5-4aba-b1d7-c13368ed7dfc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:13.115237 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7485128-a7c5-4aba-b1d7-c13368ed7dfc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:13.115757 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7485128-a7c5-4aba-b1d7-c13368ed7dfc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:13.116531 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c7485128-a7c5-4aba-b1d7-c13368ed7dfc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:13.148861 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c7485128-a7c5-4aba-b1d7-c13368ed7dfc tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments/652af9f0-2418-4f45-b50f-ca766930d442" status: 200 len: 194 microversion: 2.1 time: 0.046573 Jul 21 23:45:13.149724 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 452/864] 10.222.0.57 () {58 vars in 1412 bytes} [Thu Jul 21 23:45:13 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments/652af9f0-2418-4f45-b50f-ca766930d442 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:45:13.160957 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4f52ec4f-7dd4-4c5d-a35b-d7fef6e643a2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:13.161469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4f52ec4f-7dd4-4c5d-a35b-d7fef6e643a2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:13.167730 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f52ec4f-7dd4-4c5d-a35b-d7fef6e643a2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:13.168999 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f52ec4f-7dd4-4c5d-a35b-d7fef6e643a2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:13.169809 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f52ec4f-7dd4-4c5d-a35b-d7fef6e643a2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:13.170253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f52ec4f-7dd4-4c5d-a35b-d7fef6e643a2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:13.269524 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-4f52ec4f-7dd4-4c5d-a35b-d7fef6e643a2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lazy-loading 'services' on Instance uuid c2f95480-1f4a-48a2-8159-c7928d21cdd2 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:45:13.313869 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-87d6e869-4738-4a95-9f2a-eb870abc3bfe tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:13.321382 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-87d6e869-4738-4a95-9f2a-eb870abc3bfe tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1443 microversion: 2.1 time: 0.230193 Jul 21 23:45:13.322268 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 413/865] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:13 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1443 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:13.342882 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-245e6250-f68f-4f59-89fb-0f57c2ab8f07 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:13.343567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-245e6250-f68f-4f59-89fb-0f57c2ab8f07 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:13.350125 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-245e6250-f68f-4f59-89fb-0f57c2ab8f07 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:13.350362 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-245e6250-f68f-4f59-89fb-0f57c2ab8f07 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:13.351165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-245e6250-f68f-4f59-89fb-0f57c2ab8f07 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:13.351601 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-245e6250-f68f-4f59-89fb-0f57c2ab8f07 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:13.356900 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4f52ec4f-7dd4-4c5d-a35b-d7fef6e643a2 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments/652af9f0-2418-4f45-b50f-ca766930d442" status: 202 len: 0 microversion: 2.1 time: 0.197952 Jul 21 23:45:13.356900 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 453/866] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:45:13 2022] DELETE /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments/652af9f0-2418-4f45-b50f-ca766930d442 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:45:13.530789 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-245e6250-f68f-4f59-89fb-0f57c2ab8f07 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:13.538452 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-245e6250-f68f-4f59-89fb-0f57c2ab8f07 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1443 microversion: 2.1 time: 0.203058 Jul 21 23:45:13.539100 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 414/867] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:13 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1443 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:45:14.552331 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-02a9c525-eca0-482f-a6e8-3305a2b3fe6d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:14.553368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-02a9c525-eca0-482f-a6e8-3305a2b3fe6d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:14.561949 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-02a9c525-eca0-482f-a6e8-3305a2b3fe6d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:14.562590 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-02a9c525-eca0-482f-a6e8-3305a2b3fe6d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:14.563562 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-02a9c525-eca0-482f-a6e8-3305a2b3fe6d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:14.564007 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-02a9c525-eca0-482f-a6e8-3305a2b3fe6d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:14.594743 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-02a9c525-eca0-482f-a6e8-3305a2b3fe6d tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046609 Jul 21 23:45:14.595493 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 454/868] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:45:14 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:45:14.717500 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2cdf9946-0997-4861-b192-2d27694da391 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:14.718481 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2cdf9946-0997-4861-b192-2d27694da391 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:14.725299 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2cdf9946-0997-4861-b192-2d27694da391 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:14.725750 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2cdf9946-0997-4861-b192-2d27694da391 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:14.726534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2cdf9946-0997-4861-b192-2d27694da391 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:14.726976 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2cdf9946-0997-4861-b192-2d27694da391 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:14.757583 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2cdf9946-0997-4861-b192-2d27694da391 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044273 Jul 21 23:45:14.758143 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 415/869] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 23:45:14 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:45:14.825011 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c35760e6-fc8a-4a33-8239-cf75e7c66ecb tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:14.825686 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c35760e6-fc8a-4a33-8239-cf75e7c66ecb tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:14.832102 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c35760e6-fc8a-4a33-8239-cf75e7c66ecb tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:14.832745 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c35760e6-fc8a-4a33-8239-cf75e7c66ecb tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:14.833629 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c35760e6-fc8a-4a33-8239-cf75e7c66ecb tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:14.834069 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c35760e6-fc8a-4a33-8239-cf75e7c66ecb tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:14.861764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c35760e6-fc8a-4a33-8239-cf75e7c66ecb tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:45:14.963232 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c35760e6-fc8a-4a33-8239-cf75e7c66ecb tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 204 len: 0 microversion: 2.1 time: 0.142463 Jul 21 23:45:14.964090 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 455/870] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:45:14 2022] DELETE /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:45:14.974511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2b540ab6-6d63-4914-ba5b-1c3735c8bd5e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:14.975308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2b540ab6-6d63-4914-ba5b-1c3735c8bd5e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:14.982908 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2b540ab6-6d63-4914-ba5b-1c3735c8bd5e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:14.983691 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2b540ab6-6d63-4914-ba5b-1c3735c8bd5e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:14.984463 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2b540ab6-6d63-4914-ba5b-1c3735c8bd5e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:14.984893 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2b540ab6-6d63-4914-ba5b-1c3735c8bd5e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:15.142738 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2b540ab6-6d63-4914-ba5b-1c3735c8bd5e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:15.150430 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2b540ab6-6d63-4914-ba5b-1c3735c8bd5e tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1674 microversion: 2.1 time: 0.181258 Jul 21 23:45:15.150993 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 416/871] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:14 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:45:15.489630 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-e893f6d5-0d1a-4ad5-93de-817ba5674129 req-c534ce06-945b-418b-bdaf-f91ae8dcdbee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cff7cce-773f-4500-af5d-a369509ca64f", "tag": "55de6435-1bbb-4a44-ae52-c711d06bfe75"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:45:15.499432 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e893f6d5-0d1a-4ad5-93de-817ba5674129 req-c534ce06-945b-418b-bdaf-f91ae8dcdbee service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:15.499988 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e893f6d5-0d1a-4ad5-93de-817ba5674129 req-c534ce06-945b-418b-bdaf-f91ae8dcdbee service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:15.512246 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-e893f6d5-0d1a-4ad5-93de-817ba5674129 req-c534ce06-945b-418b-bdaf-f91ae8dcdbee service nova] Creating event network-changed:55de6435-1bbb-4a44-ae52-c711d06bfe75 for instance 3cff7cce-773f-4500-af5d-a369509ca64f on hv-cinder-85070 Jul 21 23:45:15.518770 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-e893f6d5-0d1a-4ad5-93de-817ba5674129 req-c534ce06-945b-418b-bdaf-f91ae8dcdbee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034490 Jul 21 23:45:15.519394 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 456/872] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:45:16.170058 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-49f81797-f077-4d3a-9058-60a944f7b948 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:16.170873 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-49f81797-f077-4d3a-9058-60a944f7b948 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:16.177416 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-49f81797-f077-4d3a-9058-60a944f7b948 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:16.177872 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-49f81797-f077-4d3a-9058-60a944f7b948 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:16.178642 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-49f81797-f077-4d3a-9058-60a944f7b948 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:16.179082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-49f81797-f077-4d3a-9058-60a944f7b948 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:16.317610 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-49f81797-f077-4d3a-9058-60a944f7b948 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:16.325395 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-49f81797-f077-4d3a-9058-60a944f7b948 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1674 microversion: 2.1 time: 0.159747 Jul 21 23:45:16.325972 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 417/873] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:16 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:17.343139 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a4a32b75-bffc-45dd-946d-6b343bb1a1b5 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:17.344528 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a4a32b75-bffc-45dd-946d-6b343bb1a1b5 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:17.351869 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a4a32b75-bffc-45dd-946d-6b343bb1a1b5 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:17.352497 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a4a32b75-bffc-45dd-946d-6b343bb1a1b5 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:17.353281 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a4a32b75-bffc-45dd-946d-6b343bb1a1b5 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:17.353875 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a4a32b75-bffc-45dd-946d-6b343bb1a1b5 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:17.494123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a4a32b75-bffc-45dd-946d-6b343bb1a1b5 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:17.498263 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:17.503041 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a4a32b75-bffc-45dd-946d-6b343bb1a1b5 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1674 microversion: 2.1 time: 0.164735 Jul 21 23:45:17.503610 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 457/874] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:17 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:18.221331 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-fa1e4fd3-9b1e-41de-98fb-e0d03a33dd74 req-b8be3da0-73d2-4815-a527-b21693c9900e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f95480-1f4a-48a2-8159-c7928d21cdd2", "name": "network-vif-deleted", "tag": "f00c42eb-3b9e-4025-bfef-697e24e64c46"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:45:18.234166 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-fa1e4fd3-9b1e-41de-98fb-e0d03a33dd74 req-b8be3da0-73d2-4815-a527-b21693c9900e service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:18.234625 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-fa1e4fd3-9b1e-41de-98fb-e0d03a33dd74 req-b8be3da0-73d2-4815-a527-b21693c9900e service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:18.247822 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-fa1e4fd3-9b1e-41de-98fb-e0d03a33dd74 req-b8be3da0-73d2-4815-a527-b21693c9900e service nova] Creating event network-vif-deleted:f00c42eb-3b9e-4025-bfef-697e24e64c46 for instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 on hv-cinder-85070 Jul 21 23:45:18.252948 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-fa1e4fd3-9b1e-41de-98fb-e0d03a33dd74 req-b8be3da0-73d2-4815-a527-b21693c9900e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035730 Jul 21 23:45:18.253608 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 418/875] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:45:18.520879 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0267e4c7-7690-479d-a170-de484edc4240 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:18.521633 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0267e4c7-7690-479d-a170-de484edc4240 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:18.530757 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0267e4c7-7690-479d-a170-de484edc4240 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:18.531076 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0267e4c7-7690-479d-a170-de484edc4240 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:18.531869 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0267e4c7-7690-479d-a170-de484edc4240 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:18.532471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0267e4c7-7690-479d-a170-de484edc4240 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:18.566987 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0267e4c7-7690-479d-a170-de484edc4240 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:18.567431 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0267e4c7-7690-479d-a170-de484edc4240 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:18.567874 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-0267e4c7-7690-479d-a170-de484edc4240 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lazy-loading 'fault' on Instance uuid c2f95480-1f4a-48a2-8159-c7928d21cdd2 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:45:18.611548 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0267e4c7-7690-479d-a170-de484edc4240 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2768181f8a814902b8dcf50ce32907d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:18.619269 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0267e4c7-7690-479d-a170-de484edc4240 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 200 len: 1327 microversion: 2.1 time: 0.102197 Jul 21 23:45:18.620152 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 458/876] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:18 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:19.637219 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ba2263e9-ed7f-4d14-b30b-47efa8036ab9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:19.638020 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ba2263e9-ed7f-4d14-b30b-47efa8036ab9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:19.644422 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba2263e9-ed7f-4d14-b30b-47efa8036ab9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:19.644959 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba2263e9-ed7f-4d14-b30b-47efa8036ab9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:19.645846 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba2263e9-ed7f-4d14-b30b-47efa8036ab9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:19.646352 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ba2263e9-ed7f-4d14-b30b-47efa8036ab9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:19.661684 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-ba2263e9-ed7f-4d14-b30b-47efa8036ab9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] HTTP exception thrown: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ba2263e9-ed7f-4d14-b30b-47efa8036ab9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Request method failure captured: Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 HTTP/1.1 Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2ePXFcmsxgyBLcJQWBwWfRx-PmL6Uj_XnhJDO3SJEuEGVMmnV-HuPbEx1XFA6WAacybJ6aN7L03OyY_BY0nTGphDTyu_oW01ZPws7Zg2YWLP1emGJ-M0eWu6HkSXrPJvyu1sptYU46InHK4qs5LhMaoV2yoWvpruuHAYYN3gN27B8XA Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:45:19.663351 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c9b5eb6ef5a942be9fcea8b26370a6fc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}] Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 2768181f8a814902b8dcf50ce32907d0 Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:19.664982 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': 'c2f95480-1f4a-48a2-8159-c7928d21cdd2'} Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:19.665768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:19.666978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:19.668837 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ba2263e9-ed7f-4d14-b30b-47efa8036ab9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Returning 404 to user: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:19.668837 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ba2263e9-ed7f-4d14-b30b-47efa8036ab9 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 404 len: 111 microversion: 2.1 time: 0.032523 Jul 21 23:45:19.668837 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 419/877] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:19 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:19.674103 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-698cba64-a060-434a-8af9-323ccc24e4ca tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '.version_select at 0x7f7d289953a0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:19.691924 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-698cba64-a060-434a-8af9-323ccc24e4ca tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538121688" status: 202 len: 0 microversion: 2.1 time: 0.021432 Jul 21 23:45:19.692497 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 459/878] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jul 21 23:45:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538121688 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:45:22.609570 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-37ad9e02-8004-451c-a51d-db46e6b92860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:22.610072 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-37ad9e02-8004-451c-a51d-db46e6b92860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:22.616802 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-37ad9e02-8004-451c-a51d-db46e6b92860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:22.617210 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-37ad9e02-8004-451c-a51d-db46e6b92860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:22.617985 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-37ad9e02-8004-451c-a51d-db46e6b92860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:22.618425 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-37ad9e02-8004-451c-a51d-db46e6b92860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:22.632086 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-37ad9e02-8004-451c-a51d-db46e6b92860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] HTTP exception thrown: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-37ad9e02-8004-451c-a51d-db46e6b92860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Request method failure captured: Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: DELETE /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 HTTP/1.1 Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2ePXFcmsxgyBLcJQWBwWfRx-PmL6Uj_XnhJDO3SJEuEGVMmnV-HuPbEx1XFA6WAacybJ6aN7L03OyY_BY0nTGphDTyu_oW01ZPws7Zg2YWLP1emGJ-M0eWu6HkSXrPJvyu1sptYU46InHK4qs5LhMaoV2yoWvpruuHAYYN3gN27B8XA Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:45:22.633657 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c9b5eb6ef5a942be9fcea8b26370a6fc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}] Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 2768181f8a814902b8dcf50ce32907d0 Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:22.635759 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': 'c2f95480-1f4a-48a2-8159-c7928d21cdd2'} Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:22.637242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:22.638763 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:22.640308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-37ad9e02-8004-451c-a51d-db46e6b92860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Returning 404 to user: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:22.640308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-37ad9e02-8004-451c-a51d-db46e6b92860 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 404 len: 111 microversion: 2.1 time: 0.029633 Jul 21 23:45:22.640308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 420/879] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:45:22 2022] DELETE /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:22.644368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4f0eba5e-17e7-479e-a47f-11e8a26c0eaa tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:22.645033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4f0eba5e-17e7-479e-a47f-11e8a26c0eaa tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: c2f95480-1f4a-48a2-8159-c7928d21cdd2] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:22.652078 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f0eba5e-17e7-479e-a47f-11e8a26c0eaa tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:22.652716 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f0eba5e-17e7-479e-a47f-11e8a26c0eaa tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:22.653491 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f0eba5e-17e7-479e-a47f-11e8a26c0eaa tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:22.653923 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4f0eba5e-17e7-479e-a47f-11e8a26c0eaa tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:22.668528 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-4f0eba5e-17e7-479e-a47f-11e8a26c0eaa tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] HTTP exception thrown: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4f0eba5e-17e7-479e-a47f-11e8a26c0eaa tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Request method failure captured: Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 HTTP/1.1 Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2ePXFcmsxgyBLcJQWBwWfRx-PmL6Uj_XnhJDO3SJEuEGVMmnV-HuPbEx1XFA6WAacybJ6aN7L03OyY_BY0nTGphDTyu_oW01ZPws7Zg2YWLP1emGJ-M0eWu6HkSXrPJvyu1sptYU46InHK4qs5LhMaoV2yoWvpruuHAYYN3gN27B8XA Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:45:22.670148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c9b5eb6ef5a942be9fcea8b26370a6fc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}] Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 2768181f8a814902b8dcf50ce32907d0 Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:22.671718 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'c2f95480-1f4a-48a2-8159-c7928d21cdd2'} Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:22.672796 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. Jul 21 23:45:22.674355 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:22.675728 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4f0eba5e-17e7-479e-a47f-11e8a26c0eaa tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Returning 404 to user: Instance c2f95480-1f4a-48a2-8159-c7928d21cdd2 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:22.675728 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4f0eba5e-17e7-479e-a47f-11e8a26c0eaa tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2" status: 404 len: 111 microversion: 2.1 time: 0.030984 Jul 21 23:45:22.675728 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 460/880] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:22 2022] GET /compute/v2.1/servers/c2f95480-1f4a-48a2-8159-c7928d21cdd2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:25.903551 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-38433c7a-b545-4154-b7c0-e727b9c37700 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:25.904711 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-38433c7a-b545-4154-b7c0-e727b9c37700 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:25.911146 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-38433c7a-b545-4154-b7c0-e727b9c37700 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:25.911597 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-38433c7a-b545-4154-b7c0-e727b9c37700 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:25.912365 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-38433c7a-b545-4154-b7c0-e727b9c37700 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:25.912804 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-38433c7a-b545-4154-b7c0-e727b9c37700 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:25.926020 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-38433c7a-b545-4154-b7c0-e727b9c37700 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] HTTP exception thrown: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-38433c7a-b545-4154-b7c0-e727b9c37700 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Request method failure captured: Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: DELETE /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd HTTP/1.1 Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2ePXFcmsxgyBLcJQWBwWfRx-PmL6Uj_XnhJDO3SJEuEGVMmnV-HuPbEx1XFA6WAacybJ6aN7L03OyY_BY0nTGphDTyu_oW01ZPws7Zg2YWLP1emGJ-M0eWu6HkSXrPJvyu1sptYU46InHK4qs5LhMaoV2yoWvpruuHAYYN3gN27B8XA Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:45:25.927558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c9b5eb6ef5a942be9fcea8b26370a6fc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}] Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 2768181f8a814902b8dcf50ce32907d0 Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:45:25.929118 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': '946cd660-c484-440f-873a-84c4c0a208fd'} Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:25.930049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:45:25.931561 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:25.933367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-38433c7a-b545-4154-b7c0-e727b9c37700 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Returning 404 to user: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:25.933367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-38433c7a-b545-4154-b7c0-e727b9c37700 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "DELETE /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 404 len: 111 microversion: 2.1 time: 0.030481 Jul 21 23:45:25.933367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 421/881] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:45:25 2022] DELETE /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:25.937679 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-41b17a17-b7b6-4ae3-83f4-350874d13f14 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:25.938298 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-41b17a17-b7b6-4ae3-83f4-350874d13f14 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] [instance: 946cd660-c484-440f-873a-84c4c0a208fd] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:25.940656 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:25.946132 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b17a17-b7b6-4ae3-83f4-350874d13f14 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:25.946634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b17a17-b7b6-4ae3-83f4-350874d13f14 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:25.947455 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b17a17-b7b6-4ae3-83f4-350874d13f14 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:25.947899 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b17a17-b7b6-4ae3-83f4-350874d13f14 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:25.964895 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-41b17a17-b7b6-4ae3-83f4-350874d13f14 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] HTTP exception thrown: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-41b17a17-b7b6-4ae3-83f4-350874d13f14 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Request method failure captured: Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd HTTP/1.1 Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2ePXFcmsxgyBLcJQWBwWfRx-PmL6Uj_XnhJDO3SJEuEGVMmnV-HuPbEx1XFA6WAacybJ6aN7L03OyY_BY0nTGphDTyu_oW01ZPws7Zg2YWLP1emGJ-M0eWu6HkSXrPJvyu1sptYU46InHK4qs5LhMaoV2yoWvpruuHAYYN3gN27B8XA Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:45:25.966838 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c9b5eb6ef5a942be9fcea8b26370a6fc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c9b5eb6ef5a942be9fcea8b26370a6fc"}]}] Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: c9b5eb6ef5a942be9fcea8b26370a6fc Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276863556 Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 2768181f8a814902b8dcf50ce32907d0 Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeTestJSON-276863556-project Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:45:25.968221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '946cd660-c484-440f-873a-84c4c0a208fd'} Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:25.968942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. Jul 21 23:45:25.970215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:25.971304 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-41b17a17-b7b6-4ae3-83f4-350874d13f14 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] Returning 404 to user: Instance 946cd660-c484-440f-873a-84c4c0a208fd could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:25.971304 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-41b17a17-b7b6-4ae3-83f4-350874d13f14 tempest-AttachVolumeTestJSON-276863556 tempest-AttachVolumeTestJSON-276863556-project] 10.222.0.57 "GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd" status: 404 len: 111 microversion: 2.1 time: 0.034716 Jul 21 23:45:25.971304 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 461/882] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:25 2022] GET /compute/v2.1/servers/946cd660-c484-440f-873a-84c4c0a208fd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:49.241043 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ae48c9eb-0e2e-4419-b552-1d2a56602c4c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:49.242014 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ae48c9eb-0e2e-4419-b552-1d2a56602c4c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:49.244100 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=47 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:49.245547 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:49.251109 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ae48c9eb-0e2e-4419-b552-1d2a56602c4c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:49.251556 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ae48c9eb-0e2e-4419-b552-1d2a56602c4c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:49.252320 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ae48c9eb-0e2e-4419-b552-1d2a56602c4c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:49.252755 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ae48c9eb-0e2e-4419-b552-1d2a56602c4c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:49.282080 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ae48c9eb-0e2e-4419-b552-1d2a56602c4c tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045441 Jul 21 23:45:49.282660 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 422/883] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jul 21 23:45:49 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:49.341749 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-950bfd4b-b95a-436e-a85b-dc61c17f9547 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:49.342297 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-950bfd4b-b95a-436e-a85b-dc61c17f9547 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:49.344150 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=12 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:49.349635 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-950bfd4b-b95a-436e-a85b-dc61c17f9547 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:49.350078 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-950bfd4b-b95a-436e-a85b-dc61c17f9547 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:49.350880 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-950bfd4b-b95a-436e-a85b-dc61c17f9547 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:49.351320 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-950bfd4b-b95a-436e-a85b-dc61c17f9547 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:49.378438 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-950bfd4b-b95a-436e-a85b-dc61c17f9547 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:45:49.454863 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-950bfd4b-b95a-436e-a85b-dc61c17f9547 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 204 len: 0 microversion: 2.20 time: 0.117858 Jul 21 23:45:49.455488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 462/884] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jul 21 23:45:49 2022] DELETE /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 23:45:49.465537 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-76f94505-cbbd-40be-8806-fc382f1191d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:49.466086 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-76f94505-cbbd-40be-8806-fc382f1191d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:49.472192 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-76f94505-cbbd-40be-8806-fc382f1191d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:49.472620 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-76f94505-cbbd-40be-8806-fc382f1191d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:49.473587 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-76f94505-cbbd-40be-8806-fc382f1191d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:49.474027 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-76f94505-cbbd-40be-8806-fc382f1191d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:49.619029 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-76f94505-cbbd-40be-8806-fc382f1191d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:49.627453 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-76f94505-cbbd-40be-8806-fc382f1191d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:49.628992 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-76f94505-cbbd-40be-8806-fc382f1191d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:49.630314 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-76f94505-cbbd-40be-8806-fc382f1191d2 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1723 microversion: 2.20 time: 0.170196 Jul 21 23:45:49.630863 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 423/885] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:45:49 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 23:45:50.649932 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-8f7b9ff5-797f-4f89-911d-c92e9ffde507 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:50.650749 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-8f7b9ff5-797f-4f89-911d-c92e9ffde507 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:50.657680 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f7b9ff5-797f-4f89-911d-c92e9ffde507 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:50.658476 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f7b9ff5-797f-4f89-911d-c92e9ffde507 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:50.659332 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f7b9ff5-797f-4f89-911d-c92e9ffde507 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:50.659830 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-8f7b9ff5-797f-4f89-911d-c92e9ffde507 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:50.799233 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8f7b9ff5-797f-4f89-911d-c92e9ffde507 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:50.807756 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8f7b9ff5-797f-4f89-911d-c92e9ffde507 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:50.809638 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-8f7b9ff5-797f-4f89-911d-c92e9ffde507 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:50.810852 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-8f7b9ff5-797f-4f89-911d-c92e9ffde507 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1723 microversion: 2.20 time: 0.165559 Jul 21 23:45:50.811582 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 463/886] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:45:50 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:45:51.830755 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-51d91f9b-c995-4ef4-86b4-1e97a31193f4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:51.832391 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-51d91f9b-c995-4ef4-86b4-1e97a31193f4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:51.839819 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-51d91f9b-c995-4ef4-86b4-1e97a31193f4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:51.840671 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-51d91f9b-c995-4ef4-86b4-1e97a31193f4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:51.841493 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-51d91f9b-c995-4ef4-86b4-1e97a31193f4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:51.842133 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-51d91f9b-c995-4ef4-86b4-1e97a31193f4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:51.922586 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-51d91f9b-c995-4ef4-86b4-1e97a31193f4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:51.932558 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-51d91f9b-c995-4ef4-86b4-1e97a31193f4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:51.934434 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-51d91f9b-c995-4ef4-86b4-1e97a31193f4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51def40a3de745a99f67c6ef2d2bcbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9612b265be6144809add4ce9e14ff6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:51.935807 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-51d91f9b-c995-4ef4-86b4-1e97a31193f4 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 200 len: 1655 microversion: 2.20 time: 0.109496 Jul 21 23:45:51.949215 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 424/887] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:45:51 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 1655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 23:45:52.014638 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-99916cb2-5d63-437b-b087-e0e6d7efe800 req-07cbe8fd-8c5c-412a-9b81-4dff44f6c9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c3804b-cf30-461e-8f8c-30250027a445", "name": "network-vif-deleted", "tag": "dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:45:52.035137 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-99916cb2-5d63-437b-b087-e0e6d7efe800 req-07cbe8fd-8c5c-412a-9b81-4dff44f6c9c5 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:52.035825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-99916cb2-5d63-437b-b087-e0e6d7efe800 req-07cbe8fd-8c5c-412a-9b81-4dff44f6c9c5 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:52.090156 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-99916cb2-5d63-437b-b087-e0e6d7efe800 req-07cbe8fd-8c5c-412a-9b81-4dff44f6c9c5 service nova] Creating event network-vif-deleted:dbf7a1f3-9a30-4b55-aa1c-58f2d450a60e for instance a8c3804b-cf30-461e-8f8c-30250027a445 on hv-cinder-85070 Jul 21 23:45:52.099866 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-99916cb2-5d63-437b-b087-e0e6d7efe800 req-07cbe8fd-8c5c-412a-9b81-4dff44f6c9c5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088435 Jul 21 23:45:52.101313 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 464/888] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:45:52.960634 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-487acba4-4905-4c21-898c-e5a38ec24720 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:52.961322 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-487acba4-4905-4c21-898c-e5a38ec24720 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:52.968690 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-487acba4-4905-4c21-898c-e5a38ec24720 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:52.969143 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-487acba4-4905-4c21-898c-e5a38ec24720 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:52.973160 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-487acba4-4905-4c21-898c-e5a38ec24720 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:52.973665 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-487acba4-4905-4c21-898c-e5a38ec24720 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:52.989418 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-487acba4-4905-4c21-898c-e5a38ec24720 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] HTTP exception thrown: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-487acba4-4905-4c21-898c-e5a38ec24720 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Request method failure captured: Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 HTTP/1.1 Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eN5o0PmrC9o1O3oURR3UVxKax6TLQvPvlzgJ3vm4cXi8uKHCpY9bLHuKbxBpAmRwVaUFgMQpvXjdl46xcX93yjtuNm0wroSmlEIPqFRME8xn4bn1B_Ex6xo55iZu0WN7l-8x5ctcX3xO3zH0Kvt_vfDcAjjcvLp6efj1u8oU5y5NVI Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:45:52.990977 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9612b265be6144809add4ce9e14ff6ee", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}] Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 51def40a3de745a99f67c6ef2d2bcbf6 Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:52.992704 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': 'a8c3804b-cf30-461e-8f8c-30250027a445'} Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:52.993808 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:52.996282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:52.999463 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-487acba4-4905-4c21-898c-e5a38ec24720 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Returning 404 to user: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:52.999463 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-487acba4-4905-4c21-898c-e5a38ec24720 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 404 len: 111 microversion: 2.20 time: 0.035702 Jul 21 23:45:52.999463 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 425/889] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:45:52 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:45:53.007412 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d3263960-e2a6-4d43-a5bd-994e09031c84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '.version_select at 0x7f7d289300d0>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:53.031013 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d3263960-e2a6-4d43-a5bd-994e09031c84 tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-130691570" status: 204 len: 0 microversion: 2.20 time: 0.031368 Jul 21 23:45:53.031591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 465/890] 10.222.0.57 () {60 vars in 1258 bytes} [Thu Jul 21 23:45:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-130691570 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 23:45:54.970370 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5303eb01-ae0d-487b-941c-2bf7bdb04e7e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:54.970966 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5303eb01-ae0d-487b-941c-2bf7bdb04e7e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:54.978130 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5303eb01-ae0d-487b-941c-2bf7bdb04e7e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:54.978968 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5303eb01-ae0d-487b-941c-2bf7bdb04e7e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:54.980006 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5303eb01-ae0d-487b-941c-2bf7bdb04e7e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:54.980674 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5303eb01-ae0d-487b-941c-2bf7bdb04e7e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:54.996243 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-5303eb01-ae0d-487b-941c-2bf7bdb04e7e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] HTTP exception thrown: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5303eb01-ae0d-487b-941c-2bf7bdb04e7e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Request method failure captured: Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: DELETE /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 HTTP/1.1 Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eN5o0PmrC9o1O3oURR3UVxKax6TLQvPvlzgJ3vm4cXi8uKHCpY9bLHuKbxBpAmRwVaUFgMQpvXjdl46xcX93yjtuNm0wroSmlEIPqFRME8xn4bn1B_Ex6xo55iZu0WN7l-8x5ctcX3xO3zH0Kvt_vfDcAjjcvLp6efj1u8oU5y5NVI Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:45:54.997870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9612b265be6144809add4ce9e14ff6ee", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}] Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 51def40a3de745a99f67c6ef2d2bcbf6 Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:54.999527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': 'a8c3804b-cf30-461e-8f8c-30250027a445'} Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:55.000427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:55.002039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:55.004274 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5303eb01-ae0d-487b-941c-2bf7bdb04e7e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Returning 404 to user: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:55.004274 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5303eb01-ae0d-487b-941c-2bf7bdb04e7e tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 404 len: 111 microversion: 2.20 time: 0.034752 Jul 21 23:45:55.004274 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 426/891] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jul 21 23:45:54 2022] DELETE /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:45:55.011775 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-35a6c2ed-e0a3-4f27-b3fc-1e7349f1faaa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:55.012478 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-35a6c2ed-e0a3-4f27-b3fc-1e7349f1faaa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: a8c3804b-cf30-461e-8f8c-30250027a445] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:55.018935 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-35a6c2ed-e0a3-4f27-b3fc-1e7349f1faaa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:55.019242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-603744521", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452"}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:45:55.019400 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-35a6c2ed-e0a3-4f27-b3fc-1e7349f1faaa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:55.020132 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-35a6c2ed-e0a3-4f27-b3fc-1e7349f1faaa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:55.020571 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-35a6c2ed-e0a3-4f27-b3fc-1e7349f1faaa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:55.034827 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-35a6c2ed-e0a3-4f27-b3fc-1e7349f1faaa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] HTTP exception thrown: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-35a6c2ed-e0a3-4f27-b3fc-1e7349f1faaa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Request method failure captured: Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 HTTP/1.1 Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eN5o0PmrC9o1O3oURR3UVxKax6TLQvPvlzgJ3vm4cXi8uKHCpY9bLHuKbxBpAmRwVaUFgMQpvXjdl46xcX93yjtuNm0wroSmlEIPqFRME8xn4bn1B_Ex6xo55iZu0WN7l-8x5ctcX3xO3zH0Kvt_vfDcAjjcvLp6efj1u8oU5y5NVI Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:45:55.036669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9612b265be6144809add4ce9e14ff6ee", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}] Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 51def40a3de745a99f67c6ef2d2bcbf6 Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:55.038151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'a8c3804b-cf30-461e-8f8c-30250027a445'} Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:55.039559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. Jul 21 23:45:55.040857 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:55.044221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-35a6c2ed-e0a3-4f27-b3fc-1e7349f1faaa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Returning 404 to user: Instance a8c3804b-cf30-461e-8f8c-30250027a445 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:55.044221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-35a6c2ed-e0a3-4f27-b3fc-1e7349f1faaa tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445" status: 404 len: 111 microversion: 2.20 time: 0.031490 Jul 21 23:45:55.044221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 466/892] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:45:55 2022] GET /compute/v2.1/servers/a8c3804b-cf30-461e-8f8c-30250027a445 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:45:55.079089 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] validate_networks() for None {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:45:55.380152 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:45:55.380780 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:45:55.381289 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:45:55.381701 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:45:55.382389 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:45:55.392086 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:55.392767 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:55.393605 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:55.394044 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:55.411389 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Getting quotas for project 3c886fb492cd4514a0bec0539875831e. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:45:55.415406 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Getting quotas for user 6210ff430cd14131a89521868685293b and project 3c886fb492cd4514a0bec0539875831e. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:45:55.428116 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:45:55.430650 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:45:55.476643 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-68285b50-3b12-42a5-b6f2-969558449b38 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.461480 Jul 21 23:45:55.477495 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 427/893] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:45:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 23:45:55.489516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-9acb41ec-118d-42a5-aa1f-cab666dea085 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:55.490177 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-9acb41ec-118d-42a5-aa1f-cab666dea085 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:55.562814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-9acb41ec-118d-42a5-aa1f-cab666dea085 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:55.569834 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-9acb41ec-118d-42a5-aa1f-cab666dea085 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1214 microversion: 2.1 time: 0.085481 Jul 21 23:45:55.571154 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 467/894] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:55 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:56.200766 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8ad443d0-53bc-4add-aaef-c7a3767b39bf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:56.201298 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8ad443d0-53bc-4add-aaef-c7a3767b39bf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:56.207295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8ad443d0-53bc-4add-aaef-c7a3767b39bf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:56.207742 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8ad443d0-53bc-4add-aaef-c7a3767b39bf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:56.208510 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8ad443d0-53bc-4add-aaef-c7a3767b39bf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:56.208944 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8ad443d0-53bc-4add-aaef-c7a3767b39bf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:56.223194 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-8ad443d0-53bc-4add-aaef-c7a3767b39bf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] HTTP exception thrown: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8ad443d0-53bc-4add-aaef-c7a3767b39bf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Request method failure captured: Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: DELETE /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab HTTP/1.1 Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eN5o0PmrC9o1O3oURR3UVxKax6TLQvPvlzgJ3vm4cXi8uKHCpY9bLHuKbxBpAmRwVaUFgMQpvXjdl46xcX93yjtuNm0wroSmlEIPqFRME8xn4bn1B_Ex6xo55iZu0WN7l-8x5ctcX3xO3zH0Kvt_vfDcAjjcvLp6efj1u8oU5y5NVI Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:45:56.224761 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9612b265be6144809add4ce9e14ff6ee", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}] Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 51def40a3de745a99f67c6ef2d2bcbf6 Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:45:56.226455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': 'eb1e0d18-427a-456e-8ca0-c246e41f1fab'} Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:56.227344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:45:56.229534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:45:56.232102 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8ad443d0-53bc-4add-aaef-c7a3767b39bf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Returning 404 to user: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:56.232102 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8ad443d0-53bc-4add-aaef-c7a3767b39bf tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "DELETE /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 404 len: 111 microversion: 2.20 time: 0.030677 Jul 21 23:45:56.232102 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 428/895] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jul 21 23:45:56 2022] DELETE /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:45:56.234971 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-398d6342-20e9-4cfd-afcb-b6df05d9df6d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:56.235578 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-398d6342-20e9-4cfd-afcb-b6df05d9df6d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] [instance: eb1e0d18-427a-456e-8ca0-c246e41f1fab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:56.243058 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-398d6342-20e9-4cfd-afcb-b6df05d9df6d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:56.243496 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-398d6342-20e9-4cfd-afcb-b6df05d9df6d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:56.244806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-398d6342-20e9-4cfd-afcb-b6df05d9df6d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:56.245619 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-398d6342-20e9-4cfd-afcb-b6df05d9df6d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:56.259825 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-398d6342-20e9-4cfd-afcb-b6df05d9df6d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] HTTP exception thrown: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-398d6342-20e9-4cfd-afcb-b6df05d9df6d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Request method failure captured: Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab HTTP/1.1 Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eN5o0PmrC9o1O3oURR3UVxKax6TLQvPvlzgJ3vm4cXi8uKHCpY9bLHuKbxBpAmRwVaUFgMQpvXjdl46xcX93yjtuNm0wroSmlEIPqFRME8xn4bn1B_Ex6xo55iZu0WN7l-8x5ctcX3xO3zH0Kvt_vfDcAjjcvLp6efj1u8oU5y5NVI Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:45:56.262123 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9612b265be6144809add4ce9e14ff6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9612b265be6144809add4ce9e14ff6ee", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9612b265be6144809add4ce9e14ff6ee"}]}] Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 9612b265be6144809add4ce9e14ff6ee Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-52584867 Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 51def40a3de745a99f67c6ef2d2bcbf6 Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-AttachVolumeShelveTestJSON-52584867-project Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:45:56.263762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'eb1e0d18-427a-456e-8ca0-c246e41f1fab'} Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:45:56.268230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. Jul 21 23:45:56.269833 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:45:56.271821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-398d6342-20e9-4cfd-afcb-b6df05d9df6d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] Returning 404 to user: Instance eb1e0d18-427a-456e-8ca0-c246e41f1fab could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:45:56.271821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-398d6342-20e9-4cfd-afcb-b6df05d9df6d tempest-AttachVolumeShelveTestJSON-52584867 tempest-AttachVolumeShelveTestJSON-52584867-project] 10.222.0.57 "GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab" status: 404 len: 111 microversion: 2.20 time: 0.032662 Jul 21 23:45:56.271821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 468/896] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 23:45:56 2022] GET /compute/v2.1/servers/eb1e0d18-427a-456e-8ca0-c246e41f1fab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:45:56.587714 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a126f1af-dc09-4832-b699-4cc0bd8dd5e0 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:56.588922 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-a126f1af-dc09-4832-b699-4cc0bd8dd5e0 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:56.596254 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a126f1af-dc09-4832-b699-4cc0bd8dd5e0 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:56.596689 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a126f1af-dc09-4832-b699-4cc0bd8dd5e0 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:56.597719 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a126f1af-dc09-4832-b699-4cc0bd8dd5e0 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:56.598255 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a126f1af-dc09-4832-b699-4cc0bd8dd5e0 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:56.975873 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a126f1af-dc09-4832-b699-4cc0bd8dd5e0 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:56.984504 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a126f1af-dc09-4832-b699-4cc0bd8dd5e0 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1272 microversion: 2.1 time: 0.401164 Jul 21 23:45:56.985177 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 429/897] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:56 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1272 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:58.001249 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bb65a6c5-a481-4c87-88fb-7cadffc13e9f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:58.001858 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bb65a6c5-a481-4c87-88fb-7cadffc13e9f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:58.008608 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb65a6c5-a481-4c87-88fb-7cadffc13e9f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:58.009292 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb65a6c5-a481-4c87-88fb-7cadffc13e9f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:58.010781 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb65a6c5-a481-4c87-88fb-7cadffc13e9f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:58.011466 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bb65a6c5-a481-4c87-88fb-7cadffc13e9f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:58.216057 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bb65a6c5-a481-4c87-88fb-7cadffc13e9f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:58.232106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bb65a6c5-a481-4c87-88fb-7cadffc13e9f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1314 microversion: 2.1 time: 0.234546 Jul 21 23:45:58.232910 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 469/898] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:57 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:59.252432 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-872097b6-908e-4db3-ae50-55bfd83b9ea4 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:45:59.253065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-872097b6-908e-4db3-ae50-55bfd83b9ea4 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:45:59.264752 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-872097b6-908e-4db3-ae50-55bfd83b9ea4 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:59.265228 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-872097b6-908e-4db3-ae50-55bfd83b9ea4 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:59.266023 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-872097b6-908e-4db3-ae50-55bfd83b9ea4 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:59.266469 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-872097b6-908e-4db3-ae50-55bfd83b9ea4 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:59.497789 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-0b0a46f6-b472-465a-b8ae-da4f048eb40f req-970235b0-380e-4e8e-a553-99941df7ebee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a166087-de24-4f21-849c-0bab301e3c3f", "tag": "d1b00547-28df-4be8-9dc1-c7e256eb4a65"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:45:59.524269 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-872097b6-908e-4db3-ae50-55bfd83b9ea4 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:45:59.533159 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-0b0a46f6-b472-465a-b8ae-da4f048eb40f req-970235b0-380e-4e8e-a553-99941df7ebee service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:45:59.535831 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-872097b6-908e-4db3-ae50-55bfd83b9ea4 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1314 microversion: 2.1 time: 0.288727 Jul 21 23:45:59.540501 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 430/899] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:45:59 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:45:59.540679 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-0b0a46f6-b472-465a-b8ae-da4f048eb40f req-970235b0-380e-4e8e-a553-99941df7ebee service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:45:59.806300 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-0b0a46f6-b472-465a-b8ae-da4f048eb40f req-970235b0-380e-4e8e-a553-99941df7ebee service nova] Creating event network-changed:d1b00547-28df-4be8-9dc1-c7e256eb4a65 for instance 9a166087-de24-4f21-849c-0bab301e3c3f on hv-cinder-85070 Jul 21 23:45:59.812266 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-0b0a46f6-b472-465a-b8ae-da4f048eb40f req-970235b0-380e-4e8e-a553-99941df7ebee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.335302 Jul 21 23:45:59.812917 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 470/900] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:46:00.558443 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-04eb956d-0337-4491-b068-9342b7936498 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:00.559051 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-04eb956d-0337-4491-b068-9342b7936498 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:00.565699 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-04eb956d-0337-4491-b068-9342b7936498 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:00.566172 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-04eb956d-0337-4491-b068-9342b7936498 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:00.566936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-04eb956d-0337-4491-b068-9342b7936498 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:00.567395 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-04eb956d-0337-4491-b068-9342b7936498 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:01.085715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-04eb956d-0337-4491-b068-9342b7936498 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:01.099412 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-04eb956d-0337-4491-b068-9342b7936498 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1314 microversion: 2.1 time: 0.545698 Jul 21 23:46:01.100576 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 431/901] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:00 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:02.122249 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-13afe719-ad11-4db2-856d-337ed3f51f3e tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:02.123851 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-13afe719-ad11-4db2-856d-337ed3f51f3e tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:02.130548 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-13afe719-ad11-4db2-856d-337ed3f51f3e tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:02.131081 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-13afe719-ad11-4db2-856d-337ed3f51f3e tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:02.132350 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-13afe719-ad11-4db2-856d-337ed3f51f3e tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:02.132856 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-13afe719-ad11-4db2-856d-337ed3f51f3e tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:02.340177 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-13afe719-ad11-4db2-856d-337ed3f51f3e tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:02.349709 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-13afe719-ad11-4db2-856d-337ed3f51f3e tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1314 microversion: 2.1 time: 0.232343 Jul 21 23:46:02.350274 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 471/902] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:02 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:03.367612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f4efde88-1ff5-41bb-b0f3-5ccf8f04e55f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:03.367612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f4efde88-1ff5-41bb-b0f3-5ccf8f04e55f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:03.374649 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f4efde88-1ff5-41bb-b0f3-5ccf8f04e55f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:03.375282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f4efde88-1ff5-41bb-b0f3-5ccf8f04e55f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:03.376172 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f4efde88-1ff5-41bb-b0f3-5ccf8f04e55f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:03.376678 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f4efde88-1ff5-41bb-b0f3-5ccf8f04e55f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:03.513345 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f4efde88-1ff5-41bb-b0f3-5ccf8f04e55f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:03.522121 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f4efde88-1ff5-41bb-b0f3-5ccf8f04e55f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1314 microversion: 2.1 time: 0.159515 Jul 21 23:46:03.522884 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 432/903] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:03 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:04.539034 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-19d731e8-d62f-4a5b-92a3-8b2e17983670 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:04.539655 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-19d731e8-d62f-4a5b-92a3-8b2e17983670 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:04.546068 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19d731e8-d62f-4a5b-92a3-8b2e17983670 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:04.546512 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19d731e8-d62f-4a5b-92a3-8b2e17983670 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:04.547267 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19d731e8-d62f-4a5b-92a3-8b2e17983670 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:04.547692 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-19d731e8-d62f-4a5b-92a3-8b2e17983670 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:04.685686 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-19d731e8-d62f-4a5b-92a3-8b2e17983670 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:04.693115 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-19d731e8-d62f-4a5b-92a3-8b2e17983670 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1314 microversion: 2.1 time: 0.157905 Jul 21 23:46:04.693789 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 472/904] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:04 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:05.204138 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-35f3b87a-f28c-427b-a43b-7316201fbacd req-ad149865-1926-4ea1-ac90-c9d4786868f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a166087-de24-4f21-849c-0bab301e3c3f", "name": "network-vif-plugged", "status": "completed", "tag": "d1b00547-28df-4be8-9dc1-c7e256eb4a65"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:05.214770 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-35f3b87a-f28c-427b-a43b-7316201fbacd req-ad149865-1926-4ea1-ac90-c9d4786868f3 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:05.215434 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-35f3b87a-f28c-427b-a43b-7316201fbacd req-ad149865-1926-4ea1-ac90-c9d4786868f3 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:05.227291 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-35f3b87a-f28c-427b-a43b-7316201fbacd req-ad149865-1926-4ea1-ac90-c9d4786868f3 service nova] Creating event network-vif-plugged:d1b00547-28df-4be8-9dc1-c7e256eb4a65 for instance 9a166087-de24-4f21-849c-0bab301e3c3f on hv-cinder-85070 Jul 21 23:46:05.232480 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-35f3b87a-f28c-427b-a43b-7316201fbacd req-ad149865-1926-4ea1-ac90-c9d4786868f3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032108 Jul 21 23:46:05.233067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 433/905] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:46:05.709652 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a1730354-4fae-4a51-84b0-c820f5772fa6 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:05.711600 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a1730354-4fae-4a51-84b0-c820f5772fa6 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:05.715915 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:05.722477 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1730354-4fae-4a51-84b0-c820f5772fa6 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:05.723455 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1730354-4fae-4a51-84b0-c820f5772fa6 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:05.724304 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1730354-4fae-4a51-84b0-c820f5772fa6 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:05.724899 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a1730354-4fae-4a51-84b0-c820f5772fa6 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:05.867495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a1730354-4fae-4a51-84b0-c820f5772fa6 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:05.875148 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a1730354-4fae-4a51-84b0-c820f5772fa6 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1314 microversion: 2.1 time: 0.169521 Jul 21 23:46:05.875717 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 473/906] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:05 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:06.888978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:06.890166 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=6 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:06.894901 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2aafc16b-81a1-4cbe-8fe1-e23155d4a959 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:06.895618 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2aafc16b-81a1-4cbe-8fe1-e23155d4a959 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:06.903344 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2aafc16b-81a1-4cbe-8fe1-e23155d4a959 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:06.903691 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2aafc16b-81a1-4cbe-8fe1-e23155d4a959 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:06.904466 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2aafc16b-81a1-4cbe-8fe1-e23155d4a959 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:06.904905 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2aafc16b-81a1-4cbe-8fe1-e23155d4a959 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:07.049212 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2aafc16b-81a1-4cbe-8fe1-e23155d4a959 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:07.057401 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2aafc16b-81a1-4cbe-8fe1-e23155d4a959 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1464 microversion: 2.1 time: 0.169270 Jul 21 23:46:07.058076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 434/907] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:06 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:07.101521 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-55d9784e-7aff-45ae-8527-914dcc1f5424 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:07.102032 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-55d9784e-7aff-45ae-8527-914dcc1f5424 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:07.109238 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-55d9784e-7aff-45ae-8527-914dcc1f5424 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:07.109831 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-55d9784e-7aff-45ae-8527-914dcc1f5424 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:07.110752 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-55d9784e-7aff-45ae-8527-914dcc1f5424 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:07.111265 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-55d9784e-7aff-45ae-8527-914dcc1f5424 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:07.137538 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-55d9784e-7aff-45ae-8527-914dcc1f5424 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:46:07.213024 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-55d9784e-7aff-45ae-8527-914dcc1f5424 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 204 len: 0 microversion: 2.1 time: 0.115085 Jul 21 23:46:07.213785 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 474/908] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:46:07 2022] DELETE /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:46:07.221863 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1e6c30b6-addf-4b68-86ed-0c984063166d tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:07.222556 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1e6c30b6-addf-4b68-86ed-0c984063166d tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:07.229019 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1e6c30b6-addf-4b68-86ed-0c984063166d tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:07.229549 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1e6c30b6-addf-4b68-86ed-0c984063166d tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:07.230381 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1e6c30b6-addf-4b68-86ed-0c984063166d tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:07.230883 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1e6c30b6-addf-4b68-86ed-0c984063166d tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:07.364696 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1e6c30b6-addf-4b68-86ed-0c984063166d tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:07.372767 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1e6c30b6-addf-4b68-86ed-0c984063166d tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1470 microversion: 2.1 time: 0.154796 Jul 21 23:46:07.373386 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 435/909] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:07 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:46:08.392079 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-79d91ade-0257-4738-8f9c-9fe9c518354f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:08.392767 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-79d91ade-0257-4738-8f9c-9fe9c518354f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:08.399324 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-79d91ade-0257-4738-8f9c-9fe9c518354f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:08.399797 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-79d91ade-0257-4738-8f9c-9fe9c518354f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:08.401291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-79d91ade-0257-4738-8f9c-9fe9c518354f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:08.401915 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-79d91ade-0257-4738-8f9c-9fe9c518354f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:08.547319 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-79d91ade-0257-4738-8f9c-9fe9c518354f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6210ff430cd14131a89521868685293b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c886fb492cd4514a0bec0539875831e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:08.551035 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-79d91ade-0257-4738-8f9c-9fe9c518354f tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 200 len: 1470 microversion: 2.1 time: 0.163167 Jul 21 23:46:08.552000 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 475/910] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:08 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:08.990972 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-63700c42-6c70-4992-be5c-805c5a67f2f1 req-f475ac8f-20c9-41fd-9cc5-fedc25e67bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a166087-de24-4f21-849c-0bab301e3c3f", "name": "network-vif-deleted", "tag": "d1b00547-28df-4be8-9dc1-c7e256eb4a65"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:09.002450 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-63700c42-6c70-4992-be5c-805c5a67f2f1 req-f475ac8f-20c9-41fd-9cc5-fedc25e67bea service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:09.003297 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-63700c42-6c70-4992-be5c-805c5a67f2f1 req-f475ac8f-20c9-41fd-9cc5-fedc25e67bea service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:09.016062 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-63700c42-6c70-4992-be5c-805c5a67f2f1 req-f475ac8f-20c9-41fd-9cc5-fedc25e67bea service nova] Creating event network-vif-deleted:d1b00547-28df-4be8-9dc1-c7e256eb4a65 for instance 9a166087-de24-4f21-849c-0bab301e3c3f on hv-cinder-85070 Jul 21 23:46:09.022502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-63700c42-6c70-4992-be5c-805c5a67f2f1 req-f475ac8f-20c9-41fd-9cc5-fedc25e67bea service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036128 Jul 21 23:46:09.024207 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 436/911] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:46:09.568554 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-57175de8-2b20-49b1-a275-d1480f37cb79 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:09.569317 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-57175de8-2b20-49b1-a275-d1480f37cb79 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] [instance: 9a166087-de24-4f21-849c-0bab301e3c3f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:09.576256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57175de8-2b20-49b1-a275-d1480f37cb79 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:09.576711 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57175de8-2b20-49b1-a275-d1480f37cb79 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:09.577536 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57175de8-2b20-49b1-a275-d1480f37cb79 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:09.577974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-57175de8-2b20-49b1-a275-d1480f37cb79 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:09.593713 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-57175de8-2b20-49b1-a275-d1480f37cb79 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] HTTP exception thrown: Instance 9a166087-de24-4f21-849c-0bab301e3c3f could not be found. Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-57175de8-2b20-49b1-a275-d1480f37cb79 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Request method failure captured: Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f HTTP/1.1 Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eUx0ADFjEqjnGtjmgjRROis-Ttxd342j1R0Vo0sPj-GDkASVHfqBTfnoDdjw6WHFQ6RPPqS4zLco-_Bwzvg2g4Ji0ZIK3Bqou57N__SWABbw4SXZwi1qAaqZ6ty6nATpt7FdomyTd1Glml6nr8suDVVOF73ivEcgt85qowXm7dF3sM Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 3c886fb492cd4514a0bec0539875831e Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesNegativeTest-1778261718 Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:46:09.595414 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3c886fb492cd4514a0bec0539875831e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3c886fb492cd4514a0bec0539875831e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3c886fb492cd4514a0bec0539875831e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3c886fb492cd4514a0bec0539875831e"}]}] Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesNegativeTest-1778261718 Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 3c886fb492cd4514a0bec0539875831e Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesNegativeTest-1778261718 Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesNegativeTest-1778261718-project Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 6210ff430cd14131a89521868685293b Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesNegativeTest-1778261718-project Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 9a166087-de24-4f21-849c-0bab301e3c3f could not be found. Jul 21 23:46:09.596806 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '9a166087-de24-4f21-849c-0bab301e3c3f'} Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a166087-de24-4f21-849c-0bab301e3c3f could not be found. Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:46:09.597860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a166087-de24-4f21-849c-0bab301e3c3f could not be found. Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a166087-de24-4f21-849c-0bab301e3c3f could not be found. Jul 21 23:46:09.599529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:46:09.600708 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-57175de8-2b20-49b1-a275-d1480f37cb79 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] Returning 404 to user: Instance 9a166087-de24-4f21-849c-0bab301e3c3f could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:46:09.600708 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-57175de8-2b20-49b1-a275-d1480f37cb79 tempest-VolumesNegativeTest-1778261718 tempest-VolumesNegativeTest-1778261718-project] 10.222.0.57 "GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f" status: 404 len: 111 microversion: 2.1 time: 0.032216 Jul 21 23:46:09.600708 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 476/912] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:09 2022] GET /compute/v2.1/servers/9a166087-de24-4f21-849c-0bab301e3c3f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:46:18.693948 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-679723511", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "networks": [{"uuid": "d2a767e5-d38b-4cfa-92cb-a53c6213f71a"}]}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:18.746208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] validate_networks() for [('d2a767e5-d38b-4cfa-92cb-a53c6213f71a', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:46:19.008717 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=66 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:19.096303 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:46:19.096730 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:46:19.097215 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:46:19.097633 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:46:19.098044 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:46:19.107383 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:19.107760 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:19.108554 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:19.108985 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:19.126699 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Getting quotas for project 003a186a40794519802dd209eeb034c3. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:46:19.130613 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Getting quotas for user 793e1f8bb3454ff8964bb78200d75de6 and project 003a186a40794519802dd209eeb034c3. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:46:19.142172 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:46:19.144488 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:46:19.188430 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f9acf184-84e3-460c-adac-ca8573ae1275 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498634 Jul 21 23:46:19.189065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 437/913] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:46:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:46:19.199457 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d1e53929-618b-4244-a355-6cd4c6ef15a4 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:19.200069 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d1e53929-618b-4244-a355-6cd4c6ef15a4 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:19.252853 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d1e53929-618b-4244-a355-6cd4c6ef15a4 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:19.260285 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d1e53929-618b-4244-a355-6cd4c6ef15a4 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 200 len: 1213 microversion: 2.1 time: 0.064596 Jul 21 23:46:19.260285 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 477/914] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:19 2022] GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:20.278583 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-fda73866-d5b9-4a29-9bfe-b685e6993816 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:20.279232 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-fda73866-d5b9-4a29-9bfe-b685e6993816 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:20.281197 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:20.287156 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fda73866-d5b9-4a29-9bfe-b685e6993816 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:20.287608 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fda73866-d5b9-4a29-9bfe-b685e6993816 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:20.288383 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fda73866-d5b9-4a29-9bfe-b685e6993816 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:20.288825 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fda73866-d5b9-4a29-9bfe-b685e6993816 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:20.382027 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-fda73866-d5b9-4a29-9bfe-b685e6993816 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:20.390229 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-fda73866-d5b9-4a29-9bfe-b685e6993816 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 200 len: 1271 microversion: 2.1 time: 0.116163 Jul 21 23:46:20.390798 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 438/915] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:20 2022] GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 1271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:21.374937 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-0648e49a-cb3d-42e3-bea6-a34ba330a2e3 req-aacdb84b-4a32-4eb1-b058-31c0f516fd6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1305e018-c1b0-4d43-b52a-514fb89787ab", "tag": "967f429f-5375-4212-bd00-085e307b18e5"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:21.378907 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:21.380368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:21.389328 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-0648e49a-cb3d-42e3-bea6-a34ba330a2e3 req-aacdb84b-4a32-4eb1-b058-31c0f516fd6a service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:21.390221 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-0648e49a-cb3d-42e3-bea6-a34ba330a2e3 req-aacdb84b-4a32-4eb1-b058-31c0f516fd6a service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:21.403106 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-0648e49a-cb3d-42e3-bea6-a34ba330a2e3 req-aacdb84b-4a32-4eb1-b058-31c0f516fd6a service nova] Creating event network-changed:967f429f-5375-4212-bd00-085e307b18e5 for instance 1305e018-c1b0-4d43-b52a-514fb89787ab on hv-cinder-85070 Jul 21 23:46:21.409094 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-0648e49a-cb3d-42e3-bea6-a34ba330a2e3 req-aacdb84b-4a32-4eb1-b058-31c0f516fd6a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037913 Jul 21 23:46:21.409715 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 478/916] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:46:21.410388 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2df39e3d-a842-4b33-bb7c-38464fe08e6d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:21.411084 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2df39e3d-a842-4b33-bb7c-38464fe08e6d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:21.418283 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2df39e3d-a842-4b33-bb7c-38464fe08e6d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:21.419159 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2df39e3d-a842-4b33-bb7c-38464fe08e6d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:21.420462 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2df39e3d-a842-4b33-bb7c-38464fe08e6d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:21.420927 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2df39e3d-a842-4b33-bb7c-38464fe08e6d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:21.661881 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2df39e3d-a842-4b33-bb7c-38464fe08e6d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:21.669802 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2df39e3d-a842-4b33-bb7c-38464fe08e6d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 200 len: 1313 microversion: 2.1 time: 0.265198 Jul 21 23:46:21.670611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 439/917] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:21 2022] GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:22.688082 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-41b963b4-26c8-46a2-a07d-d42f50420269 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:22.688966 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-41b963b4-26c8-46a2-a07d-d42f50420269 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:22.695057 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b963b4-26c8-46a2-a07d-d42f50420269 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:22.695502 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b963b4-26c8-46a2-a07d-d42f50420269 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:22.696272 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b963b4-26c8-46a2-a07d-d42f50420269 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:22.696709 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-41b963b4-26c8-46a2-a07d-d42f50420269 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:22.828640 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-41b963b4-26c8-46a2-a07d-d42f50420269 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:22.836244 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-41b963b4-26c8-46a2-a07d-d42f50420269 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 200 len: 1313 microversion: 2.1 time: 0.153189 Jul 21 23:46:22.837277 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 479/918] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:22 2022] GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:23.854442 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0a46e5d3-f7d5-45b8-8e97-55b521f4176d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:23.855113 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0a46e5d3-f7d5-45b8-8e97-55b521f4176d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:23.861812 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a46e5d3-f7d5-45b8-8e97-55b521f4176d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:23.862259 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a46e5d3-f7d5-45b8-8e97-55b521f4176d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:23.863019 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a46e5d3-f7d5-45b8-8e97-55b521f4176d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:23.863454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0a46e5d3-f7d5-45b8-8e97-55b521f4176d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:23.991295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0a46e5d3-f7d5-45b8-8e97-55b521f4176d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:23.999363 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0a46e5d3-f7d5-45b8-8e97-55b521f4176d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 200 len: 1313 microversion: 2.1 time: 0.148835 Jul 21 23:46:24.000134 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 440/919] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:23 2022] GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:25.015651 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-49dc3efd-8d9d-42d4-b78d-3f1b5bdab98b tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:25.016256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-49dc3efd-8d9d-42d4-b78d-3f1b5bdab98b tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:25.022763 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-49dc3efd-8d9d-42d4-b78d-3f1b5bdab98b tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:25.023212 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-49dc3efd-8d9d-42d4-b78d-3f1b5bdab98b tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:25.023972 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-49dc3efd-8d9d-42d4-b78d-3f1b5bdab98b tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:25.024406 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-49dc3efd-8d9d-42d4-b78d-3f1b5bdab98b tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:25.157797 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-49dc3efd-8d9d-42d4-b78d-3f1b5bdab98b tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:25.165315 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-49dc3efd-8d9d-42d4-b78d-3f1b5bdab98b tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 200 len: 1313 microversion: 2.1 time: 0.153472 Jul 21 23:46:25.165882 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 480/920] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:25 2022] GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:25.273628 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-c0609456-63d7-46d2-80cb-605b9b955010 req-aa706a91-f5f2-4957-9ec3-f201de094208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1305e018-c1b0-4d43-b52a-514fb89787ab", "name": "network-vif-plugged", "status": "completed", "tag": "967f429f-5375-4212-bd00-085e307b18e5"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:25.283060 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-c0609456-63d7-46d2-80cb-605b9b955010 req-aa706a91-f5f2-4957-9ec3-f201de094208 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:25.283548 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-c0609456-63d7-46d2-80cb-605b9b955010 req-aa706a91-f5f2-4957-9ec3-f201de094208 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:25.294689 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-c0609456-63d7-46d2-80cb-605b9b955010 req-aa706a91-f5f2-4957-9ec3-f201de094208 service nova] Creating event network-vif-plugged:967f429f-5375-4212-bd00-085e307b18e5 for instance 1305e018-c1b0-4d43-b52a-514fb89787ab on hv-cinder-85070 Jul 21 23:46:25.299597 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-c0609456-63d7-46d2-80cb-605b9b955010 req-aa706a91-f5f2-4957-9ec3-f201de094208 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029713 Jul 21 23:46:25.300188 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 441/921] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:46:26.184233 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6e4ad823-8c7b-4124-ac46-e0c891e95f48 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:26.184871 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6e4ad823-8c7b-4124-ac46-e0c891e95f48 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:26.191066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6e4ad823-8c7b-4124-ac46-e0c891e95f48 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:26.191519 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6e4ad823-8c7b-4124-ac46-e0c891e95f48 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:26.192281 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6e4ad823-8c7b-4124-ac46-e0c891e95f48 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:26.192719 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6e4ad823-8c7b-4124-ac46-e0c891e95f48 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:26.322191 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6e4ad823-8c7b-4124-ac46-e0c891e95f48 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:26.330028 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6e4ad823-8c7b-4124-ac46-e0c891e95f48 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 200 len: 1313 microversion: 2.1 time: 0.150141 Jul 21 23:46:26.330581 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 481/922] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:26 2022] GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:27.348211 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6fe720ad-e172-4be4-a8d7-58140d1c0cba tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:27.348904 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6fe720ad-e172-4be4-a8d7-58140d1c0cba tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:27.355390 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6fe720ad-e172-4be4-a8d7-58140d1c0cba tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:27.355832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6fe720ad-e172-4be4-a8d7-58140d1c0cba tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:27.356596 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6fe720ad-e172-4be4-a8d7-58140d1c0cba tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:27.357028 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6fe720ad-e172-4be4-a8d7-58140d1c0cba tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:27.491174 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6fe720ad-e172-4be4-a8d7-58140d1c0cba tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:27.498831 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6fe720ad-e172-4be4-a8d7-58140d1c0cba tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 200 len: 1496 microversion: 2.1 time: 0.155308 Jul 21 23:46:27.499394 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 442/923] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:27 2022] GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:27.873701 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e94b3ad5-cf9d-4bb9-9209-abcc65d0d9bb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:27.874231 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e94b3ad5-cf9d-4bb9-9209-abcc65d0d9bb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:27.880750 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e94b3ad5-cf9d-4bb9-9209-abcc65d0d9bb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:27.881215 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e94b3ad5-cf9d-4bb9-9209-abcc65d0d9bb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:27.881993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e94b3ad5-cf9d-4bb9-9209-abcc65d0d9bb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:27.882426 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-e94b3ad5-cf9d-4bb9-9209-abcc65d0d9bb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:27.908066 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e94b3ad5-cf9d-4bb9-9209-abcc65d0d9bb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:46:27.981767 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e94b3ad5-cf9d-4bb9-9209-abcc65d0d9bb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 204 len: 0 microversion: 2.1 time: 0.111601 Jul 21 23:46:27.982283 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 482/924] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:46:27 2022] DELETE /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:46:27.991142 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3fbd9d8b-2ff6-4240-8732-10f4a688531d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:27.991754 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3fbd9d8b-2ff6-4240-8732-10f4a688531d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:27.997793 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3fbd9d8b-2ff6-4240-8732-10f4a688531d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:27.998252 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3fbd9d8b-2ff6-4240-8732-10f4a688531d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:27.999006 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3fbd9d8b-2ff6-4240-8732-10f4a688531d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:27.999445 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3fbd9d8b-2ff6-4240-8732-10f4a688531d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:28.134762 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3fbd9d8b-2ff6-4240-8732-10f4a688531d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:28.142826 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3fbd9d8b-2ff6-4240-8732-10f4a688531d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 200 len: 1502 microversion: 2.1 time: 0.155591 Jul 21 23:46:28.143384 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 443/925] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:27 2022] GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:29.160385 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-791772ad-7cdd-448c-9ed7-fb4b8d28d962 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:29.161109 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-791772ad-7cdd-448c-9ed7-fb4b8d28d962 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:29.168131 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-791772ad-7cdd-448c-9ed7-fb4b8d28d962 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:29.168573 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-791772ad-7cdd-448c-9ed7-fb4b8d28d962 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:29.169368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-791772ad-7cdd-448c-9ed7-fb4b8d28d962 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:29.169808 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-791772ad-7cdd-448c-9ed7-fb4b8d28d962 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:29.256624 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:29.311604 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-791772ad-7cdd-448c-9ed7-fb4b8d28d962 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:29.319116 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-791772ad-7cdd-448c-9ed7-fb4b8d28d962 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 200 len: 1502 microversion: 2.1 time: 0.162982 Jul 21 23:46:29.319710 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 483/926] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:29 2022] GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:29.770851 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-43bbab4a-c720-41d9-a9ca-d896794735e1 req-4e66f551-0ff5-4744-aa7a-a2aee8bab600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1305e018-c1b0-4d43-b52a-514fb89787ab", "name": "network-vif-deleted", "tag": "967f429f-5375-4212-bd00-085e307b18e5"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:29.775745 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:29.777152 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=6 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:29.786030 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-43bbab4a-c720-41d9-a9ca-d896794735e1 req-4e66f551-0ff5-4744-aa7a-a2aee8bab600 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:29.786592 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-43bbab4a-c720-41d9-a9ca-d896794735e1 req-4e66f551-0ff5-4744-aa7a-a2aee8bab600 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:29.801199 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-43bbab4a-c720-41d9-a9ca-d896794735e1 req-4e66f551-0ff5-4744-aa7a-a2aee8bab600 service nova] Creating event network-vif-deleted:967f429f-5375-4212-bd00-085e307b18e5 for instance 1305e018-c1b0-4d43-b52a-514fb89787ab on hv-cinder-85070 Jul 21 23:46:29.806503 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-43bbab4a-c720-41d9-a9ca-d896794735e1 req-4e66f551-0ff5-4744-aa7a-a2aee8bab600 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039404 Jul 21 23:46:29.807142 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 444/927] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:46:30.336097 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-68fdeef8-9766-4fd5-b2a3-57bb1f1b07dc tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:30.337003 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-68fdeef8-9766-4fd5-b2a3-57bb1f1b07dc tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: 1305e018-c1b0-4d43-b52a-514fb89787ab] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:30.343209 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-68fdeef8-9766-4fd5-b2a3-57bb1f1b07dc tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:30.343659 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-68fdeef8-9766-4fd5-b2a3-57bb1f1b07dc tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:30.344467 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-68fdeef8-9766-4fd5-b2a3-57bb1f1b07dc tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:30.344886 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-68fdeef8-9766-4fd5-b2a3-57bb1f1b07dc tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:30.359696 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-68fdeef8-9766-4fd5-b2a3-57bb1f1b07dc tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] HTTP exception thrown: Instance 1305e018-c1b0-4d43-b52a-514fb89787ab could not be found. Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-68fdeef8-9766-4fd5-b2a3-57bb1f1b07dc tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Request method failure captured: Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab HTTP/1.1 Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eVJt2pe5jpKlc4ujdaB8aVXE4R1sxNbrcJpQ0w2VcZnPMTqanHGehxVDc1GvxgceoBzKwrIXfYqrzIvKYAvIfkDhc2cys6cVjsi8HMb1eo_sKZFUkvh98BH09xCJN07Gzabc7BFS2G0tDiR7vIN9kbeU_hCoOde5YaNcV_1U234UDg Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 003a186a40794519802dd209eeb034c3 Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesActionsTest-1757662493 Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:46:30.361634 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/003a186a40794519802dd209eeb034c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/003a186a40794519802dd209eeb034c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_003a186a40794519802dd209eeb034c3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/003a186a40794519802dd209eeb034c3"}]}] Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesActionsTest-1757662493 Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 003a186a40794519802dd209eeb034c3 Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesActionsTest-1757662493 Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesActionsTest-1757662493-project Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 793e1f8bb3454ff8964bb78200d75de6 Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesActionsTest-1757662493-project Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 1305e018-c1b0-4d43-b52a-514fb89787ab could not be found. Jul 21 23:46:30.363308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '1305e018-c1b0-4d43-b52a-514fb89787ab'} Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1305e018-c1b0-4d43-b52a-514fb89787ab could not be found. Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:46:30.364396 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1305e018-c1b0-4d43-b52a-514fb89787ab could not be found. Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1305e018-c1b0-4d43-b52a-514fb89787ab could not be found. Jul 21 23:46:30.365950 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:46:30.367314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-68fdeef8-9766-4fd5-b2a3-57bb1f1b07dc tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Returning 404 to user: Instance 1305e018-c1b0-4d43-b52a-514fb89787ab could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:46:30.367314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-68fdeef8-9766-4fd5-b2a3-57bb1f1b07dc tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab" status: 404 len: 111 microversion: 2.1 time: 0.030854 Jul 21 23:46:30.367314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 484/928] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:30 2022] GET /compute/v2.1/servers/1305e018-c1b0-4d43-b52a-514fb89787ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:46:30.440324 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1795006033", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "networks": [{"uuid": "d2a767e5-d38b-4cfa-92cb-a53c6213f71a"}]}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:30.490670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] validate_networks() for [('d2a767e5-d38b-4cfa-92cb-a53c6213f71a', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:46:31.078473 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:46:31.079065 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:46:31.079376 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:46:31.079784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:46:31.080194 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:46:31.089466 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:31.092126 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:31.093032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:31.093520 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:31.110896 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Getting quotas for project 003a186a40794519802dd209eeb034c3. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:46:31.115087 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Getting quotas for user 793e1f8bb3454ff8964bb78200d75de6 and project 003a186a40794519802dd209eeb034c3. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:46:31.127037 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:46:31.129441 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:46:31.174348 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ad3aa630-861c-495a-9069-94013847821e tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738498 Jul 21 23:46:31.175004 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 445/929] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:46:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:46:31.185565 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bfa46dba-6453-4372-8ca7-62a4d6b1f61a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:31.186175 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bfa46dba-6453-4372-8ca7-62a4d6b1f61a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:31.240302 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bfa46dba-6453-4372-8ca7-62a4d6b1f61a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:31.247616 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bfa46dba-6453-4372-8ca7-62a4d6b1f61a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 200 len: 1214 microversion: 2.1 time: 0.066570 Jul 21 23:46:31.248514 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 485/930] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:31 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:32.265012 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-fba474ef-d065-47e2-876c-ad2133b492a9 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:32.265749 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-fba474ef-d065-47e2-876c-ad2133b492a9 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:32.272724 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fba474ef-d065-47e2-876c-ad2133b492a9 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:32.273694 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fba474ef-d065-47e2-876c-ad2133b492a9 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:32.274662 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fba474ef-d065-47e2-876c-ad2133b492a9 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:32.275266 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fba474ef-d065-47e2-876c-ad2133b492a9 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:32.351612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-fba474ef-d065-47e2-876c-ad2133b492a9 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:32.360385 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-fba474ef-d065-47e2-876c-ad2133b492a9 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 200 len: 1272 microversion: 2.1 time: 0.100285 Jul 21 23:46:32.360876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 446/931] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:32 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:33.346529 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-9be31d79-6f80-4cd8-b9d2-9ad52a6dbe45 req-9a3d5e38-84f9-433a-a5c3-b0c59aafb031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9de6f54-2982-4a87-aec4-9c00797e5002", "tag": "9e0ccba4-ee35-4ffe-8eaa-8b370a8dea3d"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:33.361230 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-9be31d79-6f80-4cd8-b9d2-9ad52a6dbe45 req-9a3d5e38-84f9-433a-a5c3-b0c59aafb031 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:33.361678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-9be31d79-6f80-4cd8-b9d2-9ad52a6dbe45 req-9a3d5e38-84f9-433a-a5c3-b0c59aafb031 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:33.373075 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-9be31d79-6f80-4cd8-b9d2-9ad52a6dbe45 req-9a3d5e38-84f9-433a-a5c3-b0c59aafb031 service nova] Creating event network-changed:9e0ccba4-ee35-4ffe-8eaa-8b370a8dea3d for instance e9de6f54-2982-4a87-aec4-9c00797e5002 on hv-cinder-85070 Jul 21 23:46:33.377628 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d3493151-e1e6-44b3-9fbf-9ffec0715735 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:33.378519 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d3493151-e1e6-44b3-9fbf-9ffec0715735 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:33.378662 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-9be31d79-6f80-4cd8-b9d2-9ad52a6dbe45 req-9a3d5e38-84f9-433a-a5c3-b0c59aafb031 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036927 Jul 21 23:46:33.379439 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 486/932] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:46:33.385740 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3493151-e1e6-44b3-9fbf-9ffec0715735 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:33.386193 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3493151-e1e6-44b3-9fbf-9ffec0715735 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:33.387100 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3493151-e1e6-44b3-9fbf-9ffec0715735 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:33.387465 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d3493151-e1e6-44b3-9fbf-9ffec0715735 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:33.617142 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d3493151-e1e6-44b3-9fbf-9ffec0715735 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:33.625396 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d3493151-e1e6-44b3-9fbf-9ffec0715735 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 200 len: 1314 microversion: 2.1 time: 0.251801 Jul 21 23:46:33.625969 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 447/933] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:33 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:46:34.642291 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6d2db844-05bb-4843-b33c-f8346c1b583d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:34.643026 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6d2db844-05bb-4843-b33c-f8346c1b583d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:34.649651 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d2db844-05bb-4843-b33c-f8346c1b583d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:34.650104 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d2db844-05bb-4843-b33c-f8346c1b583d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:34.651520 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d2db844-05bb-4843-b33c-f8346c1b583d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:34.652314 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6d2db844-05bb-4843-b33c-f8346c1b583d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:34.792748 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6d2db844-05bb-4843-b33c-f8346c1b583d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:34.800556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6d2db844-05bb-4843-b33c-f8346c1b583d tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 200 len: 1314 microversion: 2.1 time: 0.162415 Jul 21 23:46:34.802808 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 487/934] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:34 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:35.819894 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-0e887ac6-97ea-4e1d-8017-9606b6721e4f tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:35.820508 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-0e887ac6-97ea-4e1d-8017-9606b6721e4f tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:35.827105 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e887ac6-97ea-4e1d-8017-9606b6721e4f tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:35.827555 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e887ac6-97ea-4e1d-8017-9606b6721e4f tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:35.828319 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e887ac6-97ea-4e1d-8017-9606b6721e4f tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:35.828757 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-0e887ac6-97ea-4e1d-8017-9606b6721e4f tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:35.961130 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-0e887ac6-97ea-4e1d-8017-9606b6721e4f tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:35.969553 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-0e887ac6-97ea-4e1d-8017-9606b6721e4f tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 200 len: 1314 microversion: 2.1 time: 0.153546 Jul 21 23:46:35.970111 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 448/935] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:35 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:36.987246 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a3899545-41c8-4632-b1d7-90b833862105 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:36.987817 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a3899545-41c8-4632-b1d7-90b833862105 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:36.994391 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a3899545-41c8-4632-b1d7-90b833862105 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:36.994939 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a3899545-41c8-4632-b1d7-90b833862105 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:36.995703 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a3899545-41c8-4632-b1d7-90b833862105 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:36.996157 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a3899545-41c8-4632-b1d7-90b833862105 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:37.129361 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a3899545-41c8-4632-b1d7-90b833862105 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:37.137137 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a3899545-41c8-4632-b1d7-90b833862105 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 200 len: 1314 microversion: 2.1 time: 0.154070 Jul 21 23:46:37.137712 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 488/936] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:36 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:37.327226 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-30009d29-313e-4a89-b56f-5f0e94fe2c38 req-b1751f7d-a206-4f03-b4e0-ff96af5f2639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9de6f54-2982-4a87-aec4-9c00797e5002", "name": "network-vif-plugged", "status": "completed", "tag": "9e0ccba4-ee35-4ffe-8eaa-8b370a8dea3d"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:37.335884 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-30009d29-313e-4a89-b56f-5f0e94fe2c38 req-b1751f7d-a206-4f03-b4e0-ff96af5f2639 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:37.336332 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-30009d29-313e-4a89-b56f-5f0e94fe2c38 req-b1751f7d-a206-4f03-b4e0-ff96af5f2639 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:37.348033 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-30009d29-313e-4a89-b56f-5f0e94fe2c38 req-b1751f7d-a206-4f03-b4e0-ff96af5f2639 service nova] Creating event network-vif-plugged:9e0ccba4-ee35-4ffe-8eaa-8b370a8dea3d for instance e9de6f54-2982-4a87-aec4-9c00797e5002 on hv-cinder-85070 Jul 21 23:46:37.353083 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-30009d29-313e-4a89-b56f-5f0e94fe2c38 req-b1751f7d-a206-4f03-b4e0-ff96af5f2639 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029524 Jul 21 23:46:37.353771 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 449/937] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:46:38.154308 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a809bc9e-d1f5-4c64-97df-9cfc580423e5 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:38.154906 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a809bc9e-d1f5-4c64-97df-9cfc580423e5 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:38.161306 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a809bc9e-d1f5-4c64-97df-9cfc580423e5 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:38.161747 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a809bc9e-d1f5-4c64-97df-9cfc580423e5 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:38.162499 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a809bc9e-d1f5-4c64-97df-9cfc580423e5 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:38.162930 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a809bc9e-d1f5-4c64-97df-9cfc580423e5 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:38.293479 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a809bc9e-d1f5-4c64-97df-9cfc580423e5 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:38.304973 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a809bc9e-d1f5-4c64-97df-9cfc580423e5 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 200 len: 1314 microversion: 2.1 time: 0.154674 Jul 21 23:46:38.306043 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 489/938] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:38 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:39.325505 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-55c39f57-4474-4402-908d-bd72ca637dfb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:39.326197 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-55c39f57-4474-4402-908d-bd72ca637dfb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:39.332676 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55c39f57-4474-4402-908d-bd72ca637dfb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:39.333067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55c39f57-4474-4402-908d-bd72ca637dfb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:39.333856 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55c39f57-4474-4402-908d-bd72ca637dfb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:39.334291 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-55c39f57-4474-4402-908d-bd72ca637dfb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:39.467127 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-55c39f57-4474-4402-908d-bd72ca637dfb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:39.474700 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-55c39f57-4474-4402-908d-bd72ca637dfb tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 200 len: 1498 microversion: 2.1 time: 0.154602 Jul 21 23:46:39.475302 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 450/939] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:39 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:39.884099 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-7add57db-dc71-4393-87f3-eee0b2dadb1a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:39.884597 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7add57db-dc71-4393-87f3-eee0b2dadb1a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:39.891092 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7add57db-dc71-4393-87f3-eee0b2dadb1a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:39.891545 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7add57db-dc71-4393-87f3-eee0b2dadb1a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:39.892306 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7add57db-dc71-4393-87f3-eee0b2dadb1a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:39.892754 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-7add57db-dc71-4393-87f3-eee0b2dadb1a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:39.918641 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-7add57db-dc71-4393-87f3-eee0b2dadb1a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:46:39.990785 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-7add57db-dc71-4393-87f3-eee0b2dadb1a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 204 len: 0 microversion: 2.1 time: 0.110204 Jul 21 23:46:39.994715 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 490/940] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:46:39 2022] DELETE /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:46:39.999645 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8b624c69-3c80-432e-9f80-8d3094334e5a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:40.000279 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8b624c69-3c80-432e-9f80-8d3094334e5a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:40.006476 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b624c69-3c80-432e-9f80-8d3094334e5a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:40.007079 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b624c69-3c80-432e-9f80-8d3094334e5a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:40.007856 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b624c69-3c80-432e-9f80-8d3094334e5a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:40.008330 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b624c69-3c80-432e-9f80-8d3094334e5a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:40.139864 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-8b624c69-3c80-432e-9f80-8d3094334e5a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:40.147348 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8b624c69-3c80-432e-9f80-8d3094334e5a tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 200 len: 1504 microversion: 2.1 time: 0.151606 Jul 21 23:46:40.147933 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 451/941] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:39 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:41.166182 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-1a10a5b2-e2a2-4eab-bd65-f9a04ff2c476 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:41.167428 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-1a10a5b2-e2a2-4eab-bd65-f9a04ff2c476 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:41.177574 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1a10a5b2-e2a2-4eab-bd65-f9a04ff2c476 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:41.178008 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1a10a5b2-e2a2-4eab-bd65-f9a04ff2c476 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:41.178784 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1a10a5b2-e2a2-4eab-bd65-f9a04ff2c476 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:41.179213 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-1a10a5b2-e2a2-4eab-bd65-f9a04ff2c476 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:41.245466 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:41.328397 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-1a10a5b2-e2a2-4eab-bd65-f9a04ff2c476 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:41.336072 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-1a10a5b2-e2a2-4eab-bd65-f9a04ff2c476 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 200 len: 1504 microversion: 2.1 time: 0.174348 Jul 21 23:46:41.336645 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 491/942] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:41 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:42.063659 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-d9b31a43-2fee-46bc-b483-088a3a63759f req-7fe8b4a5-33e3-4cd3-90ba-015d544cb303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9de6f54-2982-4a87-aec4-9c00797e5002", "name": "network-vif-deleted", "tag": "9e0ccba4-ee35-4ffe-8eaa-8b370a8dea3d"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:42.067566 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:42.068403 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=6 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:42.074511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-d9b31a43-2fee-46bc-b483-088a3a63759f req-7fe8b4a5-33e3-4cd3-90ba-015d544cb303 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:42.074944 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-d9b31a43-2fee-46bc-b483-088a3a63759f req-7fe8b4a5-33e3-4cd3-90ba-015d544cb303 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:42.086202 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-d9b31a43-2fee-46bc-b483-088a3a63759f req-7fe8b4a5-33e3-4cd3-90ba-015d544cb303 service nova] Creating event network-vif-deleted:9e0ccba4-ee35-4ffe-8eaa-8b370a8dea3d for instance e9de6f54-2982-4a87-aec4-9c00797e5002 on hv-cinder-85070 Jul 21 23:46:42.091697 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-d9b31a43-2fee-46bc-b483-088a3a63759f req-7fe8b4a5-33e3-4cd3-90ba-015d544cb303 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031753 Jul 21 23:46:42.092451 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 452/943] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:46:42.353267 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d1714aa6-e86c-445c-b826-b9fd9cff8131 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:42.354056 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d1714aa6-e86c-445c-b826-b9fd9cff8131 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:42.360591 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1714aa6-e86c-445c-b826-b9fd9cff8131 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:42.361336 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1714aa6-e86c-445c-b826-b9fd9cff8131 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:42.362107 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1714aa6-e86c-445c-b826-b9fd9cff8131 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:42.362546 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1714aa6-e86c-445c-b826-b9fd9cff8131 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:42.393549 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1714aa6-e86c-445c-b826-b9fd9cff8131 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:42.393998 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d1714aa6-e86c-445c-b826-b9fd9cff8131 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:42.394452 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-d1714aa6-e86c-445c-b826-b9fd9cff8131 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lazy-loading 'fault' on Instance uuid e9de6f54-2982-4a87-aec4-9c00797e5002 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:46:42.439022 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d1714aa6-e86c-445c-b826-b9fd9cff8131 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793e1f8bb3454ff8964bb78200d75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003a186a40794519802dd209eeb034c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:42.448395 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d1714aa6-e86c-445c-b826-b9fd9cff8131 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 200 len: 1304 microversion: 2.1 time: 0.099003 Jul 21 23:46:42.448960 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 492/944] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:42 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:43.466914 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-be78cf32-7391-480c-8b5a-dfe8864bab15 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:43.467607 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-be78cf32-7391-480c-8b5a-dfe8864bab15 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] [instance: e9de6f54-2982-4a87-aec4-9c00797e5002] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:43.473747 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-be78cf32-7391-480c-8b5a-dfe8864bab15 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:43.474192 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-be78cf32-7391-480c-8b5a-dfe8864bab15 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:43.474951 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-be78cf32-7391-480c-8b5a-dfe8864bab15 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:43.475385 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-be78cf32-7391-480c-8b5a-dfe8864bab15 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:43.489309 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-be78cf32-7391-480c-8b5a-dfe8864bab15 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] HTTP exception thrown: Instance e9de6f54-2982-4a87-aec4-9c00797e5002 could not be found. Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-be78cf32-7391-480c-8b5a-dfe8864bab15 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Request method failure captured: Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 HTTP/1.1 Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eVJt2pe5jpKlc4ujdaB8aVXE4R1sxNbrcJpQ0w2VcZnPMTqanHGehxVDc1GvxgceoBzKwrIXfYqrzIvKYAvIfkDhc2cys6cVjsi8HMb1eo_sKZFUkvh98BH09xCJN07Gzabc7BFS2G0tDiR7vIN9kbeU_hCoOde5YaNcV_1U234UDg Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 003a186a40794519802dd209eeb034c3 Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-VolumesActionsTest-1757662493 Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:46:43.490936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/003a186a40794519802dd209eeb034c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/003a186a40794519802dd209eeb034c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_003a186a40794519802dd209eeb034c3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/003a186a40794519802dd209eeb034c3"}]}] Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-VolumesActionsTest-1757662493 Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 003a186a40794519802dd209eeb034c3 Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-VolumesActionsTest-1757662493 Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-VolumesActionsTest-1757662493-project Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 793e1f8bb3454ff8964bb78200d75de6 Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-VolumesActionsTest-1757662493-project Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance e9de6f54-2982-4a87-aec4-9c00797e5002 could not be found. Jul 21 23:46:43.492502 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': 'e9de6f54-2982-4a87-aec4-9c00797e5002'} Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9de6f54-2982-4a87-aec4-9c00797e5002 could not be found. Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:46:43.493367 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9de6f54-2982-4a87-aec4-9c00797e5002 could not be found. Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9de6f54-2982-4a87-aec4-9c00797e5002 could not be found. Jul 21 23:46:43.495646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:46:43.496952 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-be78cf32-7391-480c-8b5a-dfe8864bab15 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] Returning 404 to user: Instance e9de6f54-2982-4a87-aec4-9c00797e5002 could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:46:43.496952 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-be78cf32-7391-480c-8b5a-dfe8864bab15 tempest-VolumesActionsTest-1757662493 tempest-VolumesActionsTest-1757662493-project] 10.222.0.57 "GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002" status: 404 len: 111 microversion: 2.1 time: 0.030180 Jul 21 23:46:43.496952 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 453/945] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:43 2022] GET /compute/v2.1/servers/e9de6f54-2982-4a87-aec4-9c00797e5002 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:46:52.841577 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1531963303", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1308624493", "security_groups": [{"name": "tempest-secgroup-smoke-311382891"}], "block_device_mapping_v2": [{"uuid": "1ee6ce45-9738-4295-a44b-f77027f0f3f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "090d43b6-0e83-430b-8cf2-7b66d14a91c7"}]}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:52.853502 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:52.854469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:52.991976 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.network.neutron [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] validate_networks() for [('090d43b6-0e83-430b-8cf2-7b66d14a91c7', None, None, None, None, None)] {{(pid=124388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:46:53.425758 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Flavor limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:46:53.426183 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Image limits 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:46:53.426651 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Flavor pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:46:53.427259 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Image pref 0:0:0 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:46:53.427846 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.virt.hardware [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:46:53.439993 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:53.440440 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:53.441257 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:53.441694 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:53.463670 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Getting quotas for project 44fb74dd337c49a898397e3482e4305d. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:46:53.467988 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.quota [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Getting quotas for user 26738ea4f6d54d7d81f1ec5057c237ff and project 44fb74dd337c49a898397e3482e4305d. Resources: {'cores', 'instances', 'ram'} {{(pid=124388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:46:53.532151 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Going to run 1 instances... {{(pid=124388) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:46:53.534311 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ee6ce45-9738-4295-a44b-f77027f0f3f3',volume_size=None,volume_type=None)] {{(pid=124388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:46:53.695206 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c163e222-6edd-4efe-8620-5739785e1395 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.859608 Jul 21 23:46:53.702865 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 493/946] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:46:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:46:53.708491 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3865c65f-3b57-45d6-904f-f4b5fee999df tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:53.710449 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3865c65f-3b57-45d6-904f-f4b5fee999df tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:53.713493 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:53.715254 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=74 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:53.797384 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3865c65f-3b57-45d6-904f-f4b5fee999df tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:53.807066 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3865c65f-3b57-45d6-904f-f4b5fee999df tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1095 microversion: 2.1 time: 0.102626 Jul 21 23:46:53.818521 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 454/947] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:53 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1095 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:54.829862 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-804ffdeb-9dd7-4483-9564-37344aeb57f8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:54.830460 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-804ffdeb-9dd7-4483-9564-37344aeb57f8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:54.846932 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-804ffdeb-9dd7-4483-9564-37344aeb57f8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:54.848459 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-804ffdeb-9dd7-4483-9564-37344aeb57f8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:54.849566 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-804ffdeb-9dd7-4483-9564-37344aeb57f8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:54.853028 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-804ffdeb-9dd7-4483-9564-37344aeb57f8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:54.950635 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-804ffdeb-9dd7-4483-9564-37344aeb57f8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:54.959087 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-804ffdeb-9dd7-4483-9564-37344aeb57f8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1211 microversion: 2.1 time: 0.137516 Jul 21 23:46:54.960090 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 494/948] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:54 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1211 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:55.980885 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-16440045-e6e5-4db9-b63d-6438fa8eeeb9 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:55.981693 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-16440045-e6e5-4db9-b63d-6438fa8eeeb9 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:56.003231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-16440045-e6e5-4db9-b63d-6438fa8eeeb9 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:56.003988 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-16440045-e6e5-4db9-b63d-6438fa8eeeb9 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:56.005132 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-16440045-e6e5-4db9-b63d-6438fa8eeeb9 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:56.006025 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-16440045-e6e5-4db9-b63d-6438fa8eeeb9 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:56.303403 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-16440045-e6e5-4db9-b63d-6438fa8eeeb9 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:56.312936 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-16440045-e6e5-4db9-b63d-6438fa8eeeb9 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1266 microversion: 2.1 time: 0.338658 Jul 21 23:46:56.313693 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 455/949] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:55 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:56.619149 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-4ad4c25a-aad9-4641-a045-31f4525f62e4 req-c2a539a5-ce90-4156-af85-faa89b88b251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a7c2ac-d9f2-4d30-9522-c4988512764c", "tag": "c7e76131-2329-43d4-94e0-0bb4e5b2956f"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:46:56.632642 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4ad4c25a-aad9-4641-a045-31f4525f62e4 req-c2a539a5-ce90-4156-af85-faa89b88b251 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:56.633429 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4ad4c25a-aad9-4641-a045-31f4525f62e4 req-c2a539a5-ce90-4156-af85-faa89b88b251 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:56.672880 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-4ad4c25a-aad9-4641-a045-31f4525f62e4 req-c2a539a5-ce90-4156-af85-faa89b88b251 service nova] Creating event network-changed:c7e76131-2329-43d4-94e0-0bb4e5b2956f for instance 14a7c2ac-d9f2-4d30-9522-c4988512764c on hv-cinder-85070 Jul 21 23:46:56.684821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-4ad4c25a-aad9-4641-a045-31f4525f62e4 req-c2a539a5-ce90-4156-af85-faa89b88b251 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068980 Jul 21 23:46:56.687134 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 495/950] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:46:57.332282 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9e8e7f79-024d-4f8e-b815-24a1bb927c7d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:57.333752 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9e8e7f79-024d-4f8e-b815-24a1bb927c7d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:57.342898 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9e8e7f79-024d-4f8e-b815-24a1bb927c7d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:57.343736 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9e8e7f79-024d-4f8e-b815-24a1bb927c7d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:57.344948 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9e8e7f79-024d-4f8e-b815-24a1bb927c7d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:57.345725 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9e8e7f79-024d-4f8e-b815-24a1bb927c7d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:57.544385 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9e8e7f79-024d-4f8e-b815-24a1bb927c7d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:57.555325 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9e8e7f79-024d-4f8e-b815-24a1bb927c7d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1266 microversion: 2.1 time: 0.227767 Jul 21 23:46:57.565639 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 456/951] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:57 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:58.573669 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d8579d8a-0d7a-433b-8ded-ebb6ac1cd95c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:58.574366 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d8579d8a-0d7a-433b-8ded-ebb6ac1cd95c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:58.580902 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d8579d8a-0d7a-433b-8ded-ebb6ac1cd95c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:58.581589 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d8579d8a-0d7a-433b-8ded-ebb6ac1cd95c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:58.582609 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d8579d8a-0d7a-433b-8ded-ebb6ac1cd95c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:58.583273 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d8579d8a-0d7a-433b-8ded-ebb6ac1cd95c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:58.734289 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-d8579d8a-0d7a-433b-8ded-ebb6ac1cd95c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:58.744443 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d8579d8a-0d7a-433b-8ded-ebb6ac1cd95c tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1266 microversion: 2.1 time: 0.175614 Jul 21 23:46:58.745320 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 496/952] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:58 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:46:59.764031 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4d4c35e8-cf71-44a3-85f0-9712edc7b679 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:46:59.765346 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4d4c35e8-cf71-44a3-85f0-9712edc7b679 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:46:59.772386 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4d4c35e8-cf71-44a3-85f0-9712edc7b679 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:59.772865 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4d4c35e8-cf71-44a3-85f0-9712edc7b679 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:59.773790 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4d4c35e8-cf71-44a3-85f0-9712edc7b679 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:46:59.774231 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4d4c35e8-cf71-44a3-85f0-9712edc7b679 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:46:59.925337 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4d4c35e8-cf71-44a3-85f0-9712edc7b679 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:46:59.937212 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4d4c35e8-cf71-44a3-85f0-9712edc7b679 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1266 microversion: 2.1 time: 0.178321 Jul 21 23:46:59.946459 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 457/953] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:46:59 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:00.954048 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a8d45248-8037-4055-979f-47eed3c368eb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:00.955466 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a8d45248-8037-4055-979f-47eed3c368eb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:00.963750 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8d45248-8037-4055-979f-47eed3c368eb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:00.963750 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8d45248-8037-4055-979f-47eed3c368eb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:00.964739 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8d45248-8037-4055-979f-47eed3c368eb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:00.965325 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a8d45248-8037-4055-979f-47eed3c368eb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:01.120656 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-a8d45248-8037-4055-979f-47eed3c368eb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:01.129739 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a8d45248-8037-4055-979f-47eed3c368eb tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1266 microversion: 2.1 time: 0.179494 Jul 21 23:47:01.130848 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 497/954] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:00 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:02.152328 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6c8ff4a4-0a19-4cb9-9b6a-33ae3ae9f698 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:02.154122 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6c8ff4a4-0a19-4cb9-9b6a-33ae3ae9f698 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:02.164793 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6c8ff4a4-0a19-4cb9-9b6a-33ae3ae9f698 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:02.166052 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6c8ff4a4-0a19-4cb9-9b6a-33ae3ae9f698 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:02.167894 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6c8ff4a4-0a19-4cb9-9b6a-33ae3ae9f698 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:02.168790 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6c8ff4a4-0a19-4cb9-9b6a-33ae3ae9f698 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:02.324316 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6c8ff4a4-0a19-4cb9-9b6a-33ae3ae9f698 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:02.332551 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6c8ff4a4-0a19-4cb9-9b6a-33ae3ae9f698 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1266 microversion: 2.1 time: 0.186193 Jul 21 23:47:02.333587 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 458/955] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:02 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:47:03.349602 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c765c6a1-af95-4ed8-ad39-8eca233031be tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:03.350952 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c765c6a1-af95-4ed8-ad39-8eca233031be tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:03.358626 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c765c6a1-af95-4ed8-ad39-8eca233031be tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:03.359077 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c765c6a1-af95-4ed8-ad39-8eca233031be tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:03.359853 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c765c6a1-af95-4ed8-ad39-8eca233031be tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:03.360540 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c765c6a1-af95-4ed8-ad39-8eca233031be tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:03.450624 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:03.475997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=6 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:03.507204 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c765c6a1-af95-4ed8-ad39-8eca233031be tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:03.514947 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c765c6a1-af95-4ed8-ad39-8eca233031be tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1266 microversion: 2.1 time: 0.169214 Jul 21 23:47:03.516547 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 498/956] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:03 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:04.532810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5a251f10-cc6c-4a54-bef3-df39d7e92ca4 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:04.533576 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5a251f10-cc6c-4a54-bef3-df39d7e92ca4 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:04.535922 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:04.541518 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a251f10-cc6c-4a54-bef3-df39d7e92ca4 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:04.542018 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a251f10-cc6c-4a54-bef3-df39d7e92ca4 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:04.543114 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a251f10-cc6c-4a54-bef3-df39d7e92ca4 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:04.543723 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a251f10-cc6c-4a54-bef3-df39d7e92ca4 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:04.709889 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5a251f10-cc6c-4a54-bef3-df39d7e92ca4 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:04.720833 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5a251f10-cc6c-4a54-bef3-df39d7e92ca4 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1266 microversion: 2.1 time: 0.192254 Jul 21 23:47:04.721632 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 459/957] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:04 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:47:05.740977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-fdc92094-27ac-40af-b845-04bc60ea587d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:05.742108 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-fdc92094-27ac-40af-b845-04bc60ea587d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:05.749763 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fdc92094-27ac-40af-b845-04bc60ea587d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:05.750213 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fdc92094-27ac-40af-b845-04bc60ea587d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:05.750983 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fdc92094-27ac-40af-b845-04bc60ea587d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:05.751596 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-fdc92094-27ac-40af-b845-04bc60ea587d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:05.897033 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-fdc92094-27ac-40af-b845-04bc60ea587d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:05.906928 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-fdc92094-27ac-40af-b845-04bc60ea587d tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1266 microversion: 2.1 time: 0.170642 Jul 21 23:47:05.907704 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 499/958] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:05 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:06.924311 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-282ed534-8bd3-4252-9a14-6b266be267f2 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:06.924915 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-282ed534-8bd3-4252-9a14-6b266be267f2 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:06.932732 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-282ed534-8bd3-4252-9a14-6b266be267f2 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:06.933168 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-282ed534-8bd3-4252-9a14-6b266be267f2 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:06.933959 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-282ed534-8bd3-4252-9a14-6b266be267f2 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:06.934388 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-282ed534-8bd3-4252-9a14-6b266be267f2 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:07.066632 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-282ed534-8bd3-4252-9a14-6b266be267f2 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:07.074739 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-282ed534-8bd3-4252-9a14-6b266be267f2 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1266 microversion: 2.1 time: 0.154330 Jul 21 23:47:07.075315 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 460/959] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:06 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:07.434302 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-48e19855-48f1-4a10-8c01-d0c8fc9e10c4 req-40d49040-8550-4902-b1d7-66355d3da21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a7c2ac-d9f2-4d30-9522-c4988512764c", "name": "network-vif-plugged", "status": "completed", "tag": "c7e76131-2329-43d4-94e0-0bb4e5b2956f"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:47:07.443404 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-48e19855-48f1-4a10-8c01-d0c8fc9e10c4 req-40d49040-8550-4902-b1d7-66355d3da21d service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:07.444076 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-48e19855-48f1-4a10-8c01-d0c8fc9e10c4 req-40d49040-8550-4902-b1d7-66355d3da21d service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:07.456255 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-48e19855-48f1-4a10-8c01-d0c8fc9e10c4 req-40d49040-8550-4902-b1d7-66355d3da21d service nova] Creating event network-vif-plugged:c7e76131-2329-43d4-94e0-0bb4e5b2956f for instance 14a7c2ac-d9f2-4d30-9522-c4988512764c on hv-cinder-85070 Jul 21 23:47:07.489099 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-48e19855-48f1-4a10-8c01-d0c8fc9e10c4 req-40d49040-8550-4902-b1d7-66355d3da21d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058867 Jul 21 23:47:07.490109 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 500/960] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:47:08.091090 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-731a0fbf-99e7-4a37-b888-67a0cd01df07 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:08.091829 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-731a0fbf-99e7-4a37-b888-67a0cd01df07 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:08.098299 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-731a0fbf-99e7-4a37-b888-67a0cd01df07 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:08.098749 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-731a0fbf-99e7-4a37-b888-67a0cd01df07 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:08.099524 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-731a0fbf-99e7-4a37-b888-67a0cd01df07 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:08.099961 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-731a0fbf-99e7-4a37-b888-67a0cd01df07 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:08.277430 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-731a0fbf-99e7-4a37-b888-67a0cd01df07 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:08.286999 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-731a0fbf-99e7-4a37-b888-67a0cd01df07 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1266 microversion: 2.1 time: 0.199319 Jul 21 23:47:08.287580 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 461/961] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:08 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:09.307759 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-37883732-11fb-4d0c-a660-37da92de2c41 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:09.308590 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-37883732-11fb-4d0c-a660-37da92de2c41 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:09.315705 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37883732-11fb-4d0c-a660-37da92de2c41 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:09.316232 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37883732-11fb-4d0c-a660-37da92de2c41 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:09.316997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37883732-11fb-4d0c-a660-37da92de2c41 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:09.317453 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-37883732-11fb-4d0c-a660-37da92de2c41 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:09.456350 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-37883732-11fb-4d0c-a660-37da92de2c41 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:09.464672 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-37883732-11fb-4d0c-a660-37da92de2c41 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1454 microversion: 2.1 time: 0.164041 Jul 21 23:47:09.465253 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 501/962] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:09 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:09.481962 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5e61df83-ef8a-4bcd-b9e8-50150505f924 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:09.482579 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5e61df83-ef8a-4bcd-b9e8-50150505f924 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:09.488968 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5e61df83-ef8a-4bcd-b9e8-50150505f924 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:09.489454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5e61df83-ef8a-4bcd-b9e8-50150505f924 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:09.490223 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5e61df83-ef8a-4bcd-b9e8-50150505f924 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:09.490667 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5e61df83-ef8a-4bcd-b9e8-50150505f924 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:09.627466 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5e61df83-ef8a-4bcd-b9e8-50150505f924 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:09.635599 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5e61df83-ef8a-4bcd-b9e8-50150505f924 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1454 microversion: 2.1 time: 0.158278 Jul 21 23:47:09.636161 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 462/963] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:09 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:11.644009 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-d966ebe7-47a1-44d6-bd2c-b58f80c22e71 req-a207e407-5b3f-475c-baeb-d67534c8828b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a7c2ac-d9f2-4d30-9522-c4988512764c", "tag": "c7e76131-2329-43d4-94e0-0bb4e5b2956f"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:47:11.652429 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-d966ebe7-47a1-44d6-bd2c-b58f80c22e71 req-a207e407-5b3f-475c-baeb-d67534c8828b service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:11.652821 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-d966ebe7-47a1-44d6-bd2c-b58f80c22e71 req-a207e407-5b3f-475c-baeb-d67534c8828b service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:11.664519 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-d966ebe7-47a1-44d6-bd2c-b58f80c22e71 req-a207e407-5b3f-475c-baeb-d67534c8828b service nova] Creating event network-changed:c7e76131-2329-43d4-94e0-0bb4e5b2956f for instance 14a7c2ac-d9f2-4d30-9522-c4988512764c on hv-cinder-85070 Jul 21 23:47:11.670159 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-d966ebe7-47a1-44d6-bd2c-b58f80c22e71 req-a207e407-5b3f-475c-baeb-d67534c8828b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029808 Jul 21 23:47:11.670922 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 502/964] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:47:15.477470 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1250096897", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "networks": [{"uuid": "9aaa1874-713b-419b-9d7f-bbc12b367aa3"}]}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:47:15.530723 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] validate_networks() for [('9aaa1874-713b-419b-9d7f-bbc12b367aa3', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:47:15.878152 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:47:15.878613 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:47:15.879089 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:47:15.879507 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:47:15.879924 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:47:15.889318 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:15.889773 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:15.890590 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:15.891009 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:15.908352 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Getting quotas for project 1f9a96f2aec2463e9cab476cb103b93a. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:47:15.912172 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Getting quotas for user be644b899ffe419485aac64510542000 and project 1f9a96f2aec2463e9cab476cb103b93a. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:47:15.922964 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:47:15.925236 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:47:15.970208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-731f1bbf-56b5-41e7-96b8-755abff6a6c0 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496546 Jul 21 23:47:15.970849 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 463/965] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:47:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 23:47:15.982408 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-46deeb3a-acc8-4719-a6b7-d0f29e8a2910 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:15.983094 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-46deeb3a-acc8-4719-a6b7-d0f29e8a2910 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:16.045903 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-46deeb3a-acc8-4719-a6b7-d0f29e8a2910 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:16.052801 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-46deeb3a-acc8-4719-a6b7-d0f29e8a2910 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1219 microversion: 2.1 time: 0.075779 Jul 21 23:47:16.053474 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 503/966] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:15 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:17.071074 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-205e578d-b58e-4796-bd36-8dba997bf646 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:17.071813 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-205e578d-b58e-4796-bd36-8dba997bf646 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:17.079775 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-205e578d-b58e-4796-bd36-8dba997bf646 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:17.080220 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-205e578d-b58e-4796-bd36-8dba997bf646 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:17.080972 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-205e578d-b58e-4796-bd36-8dba997bf646 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:17.081434 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-205e578d-b58e-4796-bd36-8dba997bf646 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:17.175034 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-205e578d-b58e-4796-bd36-8dba997bf646 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:17.182470 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-205e578d-b58e-4796-bd36-8dba997bf646 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1277 microversion: 2.1 time: 0.115783 Jul 21 23:47:17.183032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 464/967] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:17 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:18.160989 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-95e93302-dba3-4913-b1d2-9c354cd77884 req-f72a8963-5f22-4677-98d9-4d3b366bdb58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65", "tag": "6c438e91-9c68-4eb6-b549-d7b1b444cfa3"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:47:18.171349 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-95e93302-dba3-4913-b1d2-9c354cd77884 req-f72a8963-5f22-4677-98d9-4d3b366bdb58 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:18.171798 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-95e93302-dba3-4913-b1d2-9c354cd77884 req-f72a8963-5f22-4677-98d9-4d3b366bdb58 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:18.182681 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-95e93302-dba3-4913-b1d2-9c354cd77884 req-f72a8963-5f22-4677-98d9-4d3b366bdb58 service nova] Creating event network-changed:6c438e91-9c68-4eb6-b549-d7b1b444cfa3 for instance fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 on hv-cinder-85070 Jul 21 23:47:18.188189 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-95e93302-dba3-4913-b1d2-9c354cd77884 req-f72a8963-5f22-4677-98d9-4d3b366bdb58 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031355 Jul 21 23:47:18.188779 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 504/968] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:47:18.200334 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9da73867-684f-4bfd-af4b-8f34001b4e76 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:18.201037 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9da73867-684f-4bfd-af4b-8f34001b4e76 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:18.207734 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9da73867-684f-4bfd-af4b-8f34001b4e76 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:18.208265 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9da73867-684f-4bfd-af4b-8f34001b4e76 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:18.209114 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9da73867-684f-4bfd-af4b-8f34001b4e76 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:18.209646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9da73867-684f-4bfd-af4b-8f34001b4e76 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:18.406997 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9da73867-684f-4bfd-af4b-8f34001b4e76 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:18.414850 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9da73867-684f-4bfd-af4b-8f34001b4e76 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1319 microversion: 2.1 time: 0.218920 Jul 21 23:47:18.415424 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 465/969] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:18 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:19.434065 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-aa7989b8-7b01-4bb3-bc7c-bef0090dff15 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:19.434787 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-aa7989b8-7b01-4bb3-bc7c-bef0090dff15 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:19.440895 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aa7989b8-7b01-4bb3-bc7c-bef0090dff15 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:19.441383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aa7989b8-7b01-4bb3-bc7c-bef0090dff15 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:19.442137 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aa7989b8-7b01-4bb3-bc7c-bef0090dff15 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:19.442565 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-aa7989b8-7b01-4bb3-bc7c-bef0090dff15 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:19.572096 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-aa7989b8-7b01-4bb3-bc7c-bef0090dff15 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:19.580072 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-aa7989b8-7b01-4bb3-bc7c-bef0090dff15 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1319 microversion: 2.1 time: 0.151334 Jul 21 23:47:19.580631 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 505/970] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:19 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:20.597042 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-15fe9ca6-33a4-484e-8302-012fa8317163 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:20.597684 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-15fe9ca6-33a4-484e-8302-012fa8317163 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:20.604159 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-15fe9ca6-33a4-484e-8302-012fa8317163 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:20.604606 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-15fe9ca6-33a4-484e-8302-012fa8317163 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:20.606266 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-15fe9ca6-33a4-484e-8302-012fa8317163 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:20.606552 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-15fe9ca6-33a4-484e-8302-012fa8317163 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:20.988877 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-15fe9ca6-33a4-484e-8302-012fa8317163 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:20.996496 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-15fe9ca6-33a4-484e-8302-012fa8317163 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1319 microversion: 2.1 time: 0.403220 Jul 21 23:47:20.997059 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 466/971] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:20 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:22.013875 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-26bb6437-0d15-4d16-9caf-444f61f18168 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:22.014403 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-26bb6437-0d15-4d16-9caf-444f61f18168 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:22.020915 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26bb6437-0d15-4d16-9caf-444f61f18168 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:22.021405 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26bb6437-0d15-4d16-9caf-444f61f18168 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:22.022146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26bb6437-0d15-4d16-9caf-444f61f18168 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:22.022582 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-26bb6437-0d15-4d16-9caf-444f61f18168 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:22.154364 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-26bb6437-0d15-4d16-9caf-444f61f18168 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:22.161772 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-26bb6437-0d15-4d16-9caf-444f61f18168 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1319 microversion: 2.1 time: 0.152756 Jul 21 23:47:22.162334 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 506/972] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:22 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:23.178162 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8b9c73de-b3a6-4e60-9b43-97dac4e2db65 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:23.178893 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8b9c73de-b3a6-4e60-9b43-97dac4e2db65 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:23.186068 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b9c73de-b3a6-4e60-9b43-97dac4e2db65 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:23.186516 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b9c73de-b3a6-4e60-9b43-97dac4e2db65 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:23.187280 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b9c73de-b3a6-4e60-9b43-97dac4e2db65 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:23.187718 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8b9c73de-b3a6-4e60-9b43-97dac4e2db65 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:23.295068 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-029d1900-5b94-4fe4-80f8-d859cb4a4797 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:47:23.295944 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-029d1900-5b94-4fe4-80f8-d859cb4a4797 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:23.298376 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:23.303760 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-029d1900-5b94-4fe4-80f8-d859cb4a4797 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:23.304204 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-029d1900-5b94-4fe4-80f8-d859cb4a4797 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:23.304966 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-029d1900-5b94-4fe4-80f8-d859cb4a4797 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:23.305427 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-029d1900-5b94-4fe4-80f8-d859cb4a4797 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:23.308447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=59 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:23.318534 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-8b9c73de-b3a6-4e60-9b43-97dac4e2db65 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:23.326570 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8b9c73de-b3a6-4e60-9b43-97dac4e2db65 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1319 microversion: 2.1 time: 0.152251 Jul 21 23:47:23.327135 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 467/973] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:23 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:23.332038 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-029d1900-5b94-4fe4-80f8-d859cb4a4797 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lazy-loading 'flavor' on Instance uuid 3cff7cce-773f-4500-af5d-a369509ca64f {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:47:23.405446 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-029d1900-5b94-4fe4-80f8-d859cb4a4797 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "POST /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f/action" status: 202 len: 0 microversion: 2.1 time: 0.114873 Jul 21 23:47:23.406559 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 507/974] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:47:23 2022] POST /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:47:23.415508 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-34ad979b-2f2e-49a6-bf09-7815ad0d7fa5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:23.416123 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-34ad979b-2f2e-49a6-bf09-7815ad0d7fa5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:23.423305 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-34ad979b-2f2e-49a6-bf09-7815ad0d7fa5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:23.423902 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-34ad979b-2f2e-49a6-bf09-7815ad0d7fa5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:23.424716 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-34ad979b-2f2e-49a6-bf09-7815ad0d7fa5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:23.425220 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-34ad979b-2f2e-49a6-bf09-7815ad0d7fa5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:23.552842 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-046ad4b3-f7f3-4d24-9523-9c77e832aa88 req-ffff84b0-5274-40dd-a70c-f5f9eef62978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65", "name": "network-vif-plugged", "status": "completed", "tag": "6c438e91-9c68-4eb6-b549-d7b1b444cfa3"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:47:23.563548 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-046ad4b3-f7f3-4d24-9523-9c77e832aa88 req-ffff84b0-5274-40dd-a70c-f5f9eef62978 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:23.564002 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-046ad4b3-f7f3-4d24-9523-9c77e832aa88 req-ffff84b0-5274-40dd-a70c-f5f9eef62978 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:23.569143 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-34ad979b-2f2e-49a6-bf09-7815ad0d7fa5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:23.576756 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-046ad4b3-f7f3-4d24-9523-9c77e832aa88 req-ffff84b0-5274-40dd-a70c-f5f9eef62978 service nova] Creating event network-vif-plugged:6c438e91-9c68-4eb6-b549-d7b1b444cfa3 for instance fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 on hv-cinder-85070 Jul 21 23:47:23.577666 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-34ad979b-2f2e-49a6-bf09-7815ad0d7fa5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.167024 Jul 21 23:47:23.578345 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 468/975] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:23 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:23.582565 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-046ad4b3-f7f3-4d24-9523-9c77e832aa88 req-ffff84b0-5274-40dd-a70c-f5f9eef62978 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033838 Jul 21 23:47:23.583140 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 508/976] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:47:24.343575 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-48ce44b9-2cb0-4837-8624-7296e35a35fd tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:24.344177 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-48ce44b9-2cb0-4837-8624-7296e35a35fd tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:24.346454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:24.351768 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48ce44b9-2cb0-4837-8624-7296e35a35fd tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:24.352154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48ce44b9-2cb0-4837-8624-7296e35a35fd tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:24.352943 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48ce44b9-2cb0-4837-8624-7296e35a35fd tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:24.353409 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-48ce44b9-2cb0-4837-8624-7296e35a35fd tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:24.357153 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=81 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:24.488157 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-48ce44b9-2cb0-4837-8624-7296e35a35fd tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:24.495455 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-48ce44b9-2cb0-4837-8624-7296e35a35fd tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1319 microversion: 2.1 time: 0.155902 Jul 21 23:47:24.496633 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 469/977] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:24 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:24.596447 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-841729ec-a527-42fa-9400-1f34ad1f29ef tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:24.597176 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-841729ec-a527-42fa-9400-1f34ad1f29ef tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:24.603942 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-841729ec-a527-42fa-9400-1f34ad1f29ef tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:24.604336 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-841729ec-a527-42fa-9400-1f34ad1f29ef tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:24.605828 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-841729ec-a527-42fa-9400-1f34ad1f29ef tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:24.606438 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-841729ec-a527-42fa-9400-1f34ad1f29ef tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:24.741655 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-841729ec-a527-42fa-9400-1f34ad1f29ef tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:24.749124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-841729ec-a527-42fa-9400-1f34ad1f29ef tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.156900 Jul 21 23:47:24.749701 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 509/978] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:24 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:25.513805 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7815e204-09ed-4d20-a04b-22adb8d52fa8 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:25.514408 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7815e204-09ed-4d20-a04b-22adb8d52fa8 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:25.520753 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7815e204-09ed-4d20-a04b-22adb8d52fa8 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:25.521211 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7815e204-09ed-4d20-a04b-22adb8d52fa8 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:25.521978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7815e204-09ed-4d20-a04b-22adb8d52fa8 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:25.522406 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7815e204-09ed-4d20-a04b-22adb8d52fa8 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:25.651047 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7815e204-09ed-4d20-a04b-22adb8d52fa8 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:25.658510 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7815e204-09ed-4d20-a04b-22adb8d52fa8 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1508 microversion: 2.1 time: 0.149728 Jul 21 23:47:25.659067 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 470/979] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:25 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:25.766403 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5a853cfd-c802-4790-8a5d-b9a0fd0d4d49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:25.767024 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5a853cfd-c802-4790-8a5d-b9a0fd0d4d49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:25.773524 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5a853cfd-c802-4790-8a5d-b9a0fd0d4d49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:25.773972 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5a853cfd-c802-4790-8a5d-b9a0fd0d4d49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:25.774741 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5a853cfd-c802-4790-8a5d-b9a0fd0d4d49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:25.775177 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5a853cfd-c802-4790-8a5d-b9a0fd0d4d49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:25.919478 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5a853cfd-c802-4790-8a5d-b9a0fd0d4d49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:25.927229 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5a853cfd-c802-4790-8a5d-b9a0fd0d4d49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.165646 Jul 21 23:47:25.927761 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 510/980] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:25 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:26.945529 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-330a4de3-3af6-455d-94e8-c055a3bd5838 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:26.946119 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-330a4de3-3af6-455d-94e8-c055a3bd5838 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:26.947924 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:26.948576 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=6 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:26.955772 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-330a4de3-3af6-455d-94e8-c055a3bd5838 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:26.956218 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-330a4de3-3af6-455d-94e8-c055a3bd5838 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:26.956981 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-330a4de3-3af6-455d-94e8-c055a3bd5838 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:26.957436 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-330a4de3-3af6-455d-94e8-c055a3bd5838 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:27.095720 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-330a4de3-3af6-455d-94e8-c055a3bd5838 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:27.104635 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-330a4de3-3af6-455d-94e8-c055a3bd5838 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.162866 Jul 21 23:47:27.105330 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 471/981] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:26 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:28.125465 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-6be4b1b2-b28e-4e74-9665-47c0153d1ae0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:28.126088 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-6be4b1b2-b28e-4e74-9665-47c0153d1ae0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:28.128399 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:28.134104 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6be4b1b2-b28e-4e74-9665-47c0153d1ae0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:28.134593 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6be4b1b2-b28e-4e74-9665-47c0153d1ae0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:28.135356 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6be4b1b2-b28e-4e74-9665-47c0153d1ae0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:28.136157 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-6be4b1b2-b28e-4e74-9665-47c0153d1ae0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:28.275619 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-6be4b1b2-b28e-4e74-9665-47c0153d1ae0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:28.283427 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-6be4b1b2-b28e-4e74-9665-47c0153d1ae0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.164513 Jul 21 23:47:28.283994 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 511/982] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:28 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:29.299973 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7a1c08f9-270c-4596-925e-ac877bd951b5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:29.300614 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7a1c08f9-270c-4596-925e-ac877bd951b5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:29.307438 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7a1c08f9-270c-4596-925e-ac877bd951b5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:29.307895 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7a1c08f9-270c-4596-925e-ac877bd951b5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:29.308664 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7a1c08f9-270c-4596-925e-ac877bd951b5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:29.309103 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7a1c08f9-270c-4596-925e-ac877bd951b5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:29.452212 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7a1c08f9-270c-4596-925e-ac877bd951b5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:29.459813 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7a1c08f9-270c-4596-925e-ac877bd951b5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.163840 Jul 21 23:47:29.460373 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 472/983] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:29 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:30.476725 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c9a58f20-6617-4e29-b942-67ddd96d3c49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:30.477498 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c9a58f20-6617-4e29-b942-67ddd96d3c49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:30.485270 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9a58f20-6617-4e29-b942-67ddd96d3c49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:30.485708 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9a58f20-6617-4e29-b942-67ddd96d3c49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:30.486469 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9a58f20-6617-4e29-b942-67ddd96d3c49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:30.486898 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c9a58f20-6617-4e29-b942-67ddd96d3c49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:30.620290 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c9a58f20-6617-4e29-b942-67ddd96d3c49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:30.628471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c9a58f20-6617-4e29-b942-67ddd96d3c49 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.155608 Jul 21 23:47:30.629019 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 512/984] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:30 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:31.645974 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f3393da1-8a61-4e24-acd6-cea9f3d6735f tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:31.646566 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f3393da1-8a61-4e24-acd6-cea9f3d6735f tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:31.653049 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f3393da1-8a61-4e24-acd6-cea9f3d6735f tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:31.653528 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f3393da1-8a61-4e24-acd6-cea9f3d6735f tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:31.654890 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f3393da1-8a61-4e24-acd6-cea9f3d6735f tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:31.655342 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f3393da1-8a61-4e24-acd6-cea9f3d6735f tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:31.797266 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f3393da1-8a61-4e24-acd6-cea9f3d6735f tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:31.804760 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f3393da1-8a61-4e24-acd6-cea9f3d6735f tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.162750 Jul 21 23:47:31.805333 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 473/985] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:31 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:32.822717 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2df4c2cb-d2ff-437c-b88e-55a476a8baa4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:32.823324 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2df4c2cb-d2ff-437c-b88e-55a476a8baa4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:32.830513 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2df4c2cb-d2ff-437c-b88e-55a476a8baa4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:32.830957 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2df4c2cb-d2ff-437c-b88e-55a476a8baa4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:32.831720 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2df4c2cb-d2ff-437c-b88e-55a476a8baa4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:32.832154 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2df4c2cb-d2ff-437c-b88e-55a476a8baa4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:32.972504 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2df4c2cb-d2ff-437c-b88e-55a476a8baa4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:32.980167 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2df4c2cb-d2ff-437c-b88e-55a476a8baa4 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.161297 Jul 21 23:47:32.980735 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 513/986] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:32 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:34.001568 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-f62b4197-8cd1-4774-bd47-9adbedbe84ed tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:34.002214 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-f62b4197-8cd1-4774-bd47-9adbedbe84ed tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:34.008802 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f62b4197-8cd1-4774-bd47-9adbedbe84ed tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:34.009284 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f62b4197-8cd1-4774-bd47-9adbedbe84ed tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:34.010063 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f62b4197-8cd1-4774-bd47-9adbedbe84ed tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:34.010504 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-f62b4197-8cd1-4774-bd47-9adbedbe84ed tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:34.229869 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-f62b4197-8cd1-4774-bd47-9adbedbe84ed tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:34.238670 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-f62b4197-8cd1-4774-bd47-9adbedbe84ed tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.244573 Jul 21 23:47:34.239258 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 474/987] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:33 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:35.255835 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-354190bb-2ab5-4759-a24f-ab2b849d99cd tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:35.256450 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-354190bb-2ab5-4759-a24f-ab2b849d99cd tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:35.263077 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-354190bb-2ab5-4759-a24f-ab2b849d99cd tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:35.263523 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-354190bb-2ab5-4759-a24f-ab2b849d99cd tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:35.264288 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-354190bb-2ab5-4759-a24f-ab2b849d99cd tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:35.264734 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-354190bb-2ab5-4759-a24f-ab2b849d99cd tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:35.403519 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-354190bb-2ab5-4759-a24f-ab2b849d99cd tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:35.411192 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-354190bb-2ab5-4759-a24f-ab2b849d99cd tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.159282 Jul 21 23:47:35.411754 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 514/988] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:35 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:36.428855 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-64f7e1e7-0625-4233-9379-b7c5d110b1a5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:36.429511 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-64f7e1e7-0625-4233-9379-b7c5d110b1a5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:36.436770 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-64f7e1e7-0625-4233-9379-b7c5d110b1a5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:36.437301 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-64f7e1e7-0625-4233-9379-b7c5d110b1a5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:36.438160 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-64f7e1e7-0625-4233-9379-b7c5d110b1a5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:36.438604 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-64f7e1e7-0625-4233-9379-b7c5d110b1a5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:36.581433 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-64f7e1e7-0625-4233-9379-b7c5d110b1a5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:36.589788 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-64f7e1e7-0625-4233-9379-b7c5d110b1a5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1569 microversion: 2.1 time: 0.165500 Jul 21 23:47:36.590383 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 475/989] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:36 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:36.607240 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-883782a0-c46a-4aa9-b265-7c6d9b093b5a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:47:36.607840 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-883782a0-c46a-4aa9-b265-7c6d9b093b5a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:36.615804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-883782a0-c46a-4aa9-b265-7c6d9b093b5a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:36.616247 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-883782a0-c46a-4aa9-b265-7c6d9b093b5a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:36.617038 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-883782a0-c46a-4aa9-b265-7c6d9b093b5a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:36.617491 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-883782a0-c46a-4aa9-b265-7c6d9b093b5a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:36.706471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-883782a0-c46a-4aa9-b265-7c6d9b093b5a tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "POST /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f/action" status: 202 len: 0 microversion: 2.1 time: 0.103129 Jul 21 23:47:36.708681 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 515/990] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 23:47:36 2022] POST /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:47:36.717298 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-6667056f-b22f-4739-9f6a-8e169bf639fa tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:36.717960 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-6667056f-b22f-4739-9f6a-8e169bf639fa tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:36.725549 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6667056f-b22f-4739-9f6a-8e169bf639fa tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:36.726319 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6667056f-b22f-4739-9f6a-8e169bf639fa tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:36.726782 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6667056f-b22f-4739-9f6a-8e169bf639fa tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:36.727222 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-6667056f-b22f-4739-9f6a-8e169bf639fa tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:36.869096 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-6667056f-b22f-4739-9f6a-8e169bf639fa tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:36.876961 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-6667056f-b22f-4739-9f6a-8e169bf639fa tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1577 microversion: 2.1 time: 0.165458 Jul 21 23:47:36.877559 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 476/991] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:36 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:47:37.895295 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-4e52a791-049f-4690-8ba1-5955983fc6ff tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:37.896110 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-4e52a791-049f-4690-8ba1-5955983fc6ff tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:37.903369 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e52a791-049f-4690-8ba1-5955983fc6ff tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:37.903861 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e52a791-049f-4690-8ba1-5955983fc6ff tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:37.904834 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e52a791-049f-4690-8ba1-5955983fc6ff tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:37.905526 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-4e52a791-049f-4690-8ba1-5955983fc6ff tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:38.048150 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-4e52a791-049f-4690-8ba1-5955983fc6ff tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:38.055729 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-4e52a791-049f-4690-8ba1-5955983fc6ff tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1519 microversion: 2.1 time: 0.165396 Jul 21 23:47:38.056286 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 516/992] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:37 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:39.073223 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-b2cb48ff-e644-4418-8cfa-63c0ca039b19 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:39.073861 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-b2cb48ff-e644-4418-8cfa-63c0ca039b19 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:39.081293 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b2cb48ff-e644-4418-8cfa-63c0ca039b19 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:39.081742 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b2cb48ff-e644-4418-8cfa-63c0ca039b19 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:39.082499 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b2cb48ff-e644-4418-8cfa-63c0ca039b19 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:39.082958 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-b2cb48ff-e644-4418-8cfa-63c0ca039b19 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:39.213729 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-b2cb48ff-e644-4418-8cfa-63c0ca039b19 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:39.221302 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-b2cb48ff-e644-4418-8cfa-63c0ca039b19 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1575 microversion: 2.1 time: 0.151917 Jul 21 23:47:39.221880 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 477/993] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:39 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:39.561855 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-8296a8cf-bec2-42ba-a9df-a1b9831a45e8 req-fac11357-476b-4a28-836e-c98696c6c106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cff7cce-773f-4500-af5d-a369509ca64f", "name": "network-vif-unplugged", "status": "completed", "tag": "55de6435-1bbb-4a44-ae52-c711d06bfe75"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:47:39.570919 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-8296a8cf-bec2-42ba-a9df-a1b9831a45e8 req-fac11357-476b-4a28-836e-c98696c6c106 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:39.571365 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-8296a8cf-bec2-42ba-a9df-a1b9831a45e8 req-fac11357-476b-4a28-836e-c98696c6c106 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:39.582228 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-8296a8cf-bec2-42ba-a9df-a1b9831a45e8 req-fac11357-476b-4a28-836e-c98696c6c106 service nova] Creating event network-vif-unplugged:55de6435-1bbb-4a44-ae52-c711d06bfe75 for instance 3cff7cce-773f-4500-af5d-a369509ca64f on hv-cinder-85070 Jul 21 23:47:39.587190 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-8296a8cf-bec2-42ba-a9df-a1b9831a45e8 req-fac11357-476b-4a28-836e-c98696c6c106 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029025 Jul 21 23:47:39.587777 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 517/994] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:47:40.239020 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-33ac7ac1-925a-4923-9c6d-c3c80fb3d75e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:40.239671 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-33ac7ac1-925a-4923-9c6d-c3c80fb3d75e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:40.247124 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-33ac7ac1-925a-4923-9c6d-c3c80fb3d75e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:40.247831 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-33ac7ac1-925a-4923-9c6d-c3c80fb3d75e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:40.248665 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-33ac7ac1-925a-4923-9c6d-c3c80fb3d75e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:40.249179 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-33ac7ac1-925a-4923-9c6d-c3c80fb3d75e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:40.457870 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-33ac7ac1-925a-4923-9c6d-c3c80fb3d75e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:40.465674 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-33ac7ac1-925a-4923-9c6d-c3c80fb3d75e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1575 microversion: 2.1 time: 0.231150 Jul 21 23:47:40.466238 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 478/995] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:40 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:40.968963 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c96cff1f-4490-4eb4-8495-4bdf75b4f250 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bf00f50-eb68-4d83-868a-936a032f3ef9", "device": "/dev/sdb"}} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:47:40.970696 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c96cff1f-4490-4eb4-8495-4bdf75b4f250 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:40.976849 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c96cff1f-4490-4eb4-8495-4bdf75b4f250 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:40.977340 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c96cff1f-4490-4eb4-8495-4bdf75b4f250 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:40.978109 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c96cff1f-4490-4eb4-8495-4bdf75b4f250 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:40.978548 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c96cff1f-4490-4eb4-8495-4bdf75b4f250 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:41.213803 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c96cff1f-4490-4eb4-8495-4bdf75b4f250 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "POST /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249781 Jul 21 23:47:41.219256 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 518/996] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:47:40 2022] POST /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:47:41.483407 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-a79417cc-861f-48b3-a395-a6fd4542f755 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:41.483969 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-a79417cc-861f-48b3-a395-a6fd4542f755 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:41.490646 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a79417cc-861f-48b3-a395-a6fd4542f755 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:41.491097 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a79417cc-861f-48b3-a395-a6fd4542f755 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:41.491853 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a79417cc-861f-48b3-a395-a6fd4542f755 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:41.492290 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-a79417cc-861f-48b3-a395-a6fd4542f755 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:41.627450 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-a79417cc-861f-48b3-a395-a6fd4542f755 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:41.635144 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-a79417cc-861f-48b3-a395-a6fd4542f755 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1575 microversion: 2.1 time: 0.155647 Jul 21 23:47:41.635694 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 479/997] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:41 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:42.654345 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c202a189-3893-4b48-a371-10c358c2c216 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:42.655040 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c202a189-3893-4b48-a371-10c358c2c216 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:42.661932 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c202a189-3893-4b48-a371-10c358c2c216 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:42.662378 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c202a189-3893-4b48-a371-10c358c2c216 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:42.663136 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c202a189-3893-4b48-a371-10c358c2c216 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:42.663568 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c202a189-3893-4b48-a371-10c358c2c216 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:42.798879 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c202a189-3893-4b48-a371-10c358c2c216 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:42.806429 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c202a189-3893-4b48-a371-10c358c2c216 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1575 microversion: 2.1 time: 0.156822 Jul 21 23:47:42.806989 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 519/998] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:42 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:43.823416 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-fd29cfe7-d9e5-4414-8f24-f0f23c142a4e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:43.824055 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-fd29cfe7-d9e5-4414-8f24-f0f23c142a4e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:43.830648 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fd29cfe7-d9e5-4414-8f24-f0f23c142a4e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:43.831100 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fd29cfe7-d9e5-4414-8f24-f0f23c142a4e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:43.831863 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fd29cfe7-d9e5-4414-8f24-f0f23c142a4e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:43.832303 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-fd29cfe7-d9e5-4414-8f24-f0f23c142a4e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:43.967551 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-fd29cfe7-d9e5-4414-8f24-f0f23c142a4e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:43.975533 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-fd29cfe7-d9e5-4414-8f24-f0f23c142a4e tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1575 microversion: 2.1 time: 0.156017 Jul 21 23:47:43.976103 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 480/999] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:43 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:44.994012 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-bf7a7f9b-8c96-4181-8276-90dfbe04a87b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:44.994638 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-bf7a7f9b-8c96-4181-8276-90dfbe04a87b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:45.002328 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bf7a7f9b-8c96-4181-8276-90dfbe04a87b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:45.002781 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bf7a7f9b-8c96-4181-8276-90dfbe04a87b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:45.003566 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bf7a7f9b-8c96-4181-8276-90dfbe04a87b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:45.003987 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-bf7a7f9b-8c96-4181-8276-90dfbe04a87b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:45.142218 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-bf7a7f9b-8c96-4181-8276-90dfbe04a87b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:45.144552 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:45.151945 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-bf7a7f9b-8c96-4181-8276-90dfbe04a87b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1575 microversion: 2.1 time: 0.162354 Jul 21 23:47:45.152508 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 520/1000] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:44 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:46.168258 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-67f0c05e-1bb5-4c01-9caa-bb184a3447a7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:46.168782 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-67f0c05e-1bb5-4c01-9caa-bb184a3447a7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:46.175717 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-67f0c05e-1bb5-4c01-9caa-bb184a3447a7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:46.176163 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-67f0c05e-1bb5-4c01-9caa-bb184a3447a7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:46.176919 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-67f0c05e-1bb5-4c01-9caa-bb184a3447a7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:46.177383 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-67f0c05e-1bb5-4c01-9caa-bb184a3447a7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:46.307682 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-67f0c05e-1bb5-4c01-9caa-bb184a3447a7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:46.315610 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-67f0c05e-1bb5-4c01-9caa-bb184a3447a7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1575 microversion: 2.1 time: 0.151301 Jul 21 23:47:46.316170 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 481/1001] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:46 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:47.332826 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-95d57616-b0a5-48c0-94cd-8cdd7ec20fe7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:47:47.333503 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-95d57616-b0a5-48c0-94cd-8cdd7ec20fe7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:47:47.340997 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95d57616-b0a5-48c0-94cd-8cdd7ec20fe7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:47.341475 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95d57616-b0a5-48c0-94cd-8cdd7ec20fe7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:47.342242 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95d57616-b0a5-48c0-94cd-8cdd7ec20fe7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:47.342678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-95d57616-b0a5-48c0-94cd-8cdd7ec20fe7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:47.476645 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-95d57616-b0a5-48c0-94cd-8cdd7ec20fe7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:47:47.484483 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-95d57616-b0a5-48c0-94cd-8cdd7ec20fe7 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1562 microversion: 2.1 time: 0.156258 Jul 21 23:47:47.489803 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 521/1002] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:47:47 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:47:47.783464 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-d29a9930-dfd6-4ca1-905b-8b2892053745 req-2a46254e-56c0-4c1f-a48f-45f5351c7082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cff7cce-773f-4500-af5d-a369509ca64f", "name": "network-vif-plugged", "status": "completed", "tag": "55de6435-1bbb-4a44-ae52-c711d06bfe75"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:47:47.792015 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-d29a9930-dfd6-4ca1-905b-8b2892053745 req-2a46254e-56c0-4c1f-a48f-45f5351c7082 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:47:47.792456 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-d29a9930-dfd6-4ca1-905b-8b2892053745 req-2a46254e-56c0-4c1f-a48f-45f5351c7082 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:47:47.804230 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-d29a9930-dfd6-4ca1-905b-8b2892053745 req-2a46254e-56c0-4c1f-a48f-45f5351c7082 service nova] Creating event network-vif-plugged:55de6435-1bbb-4a44-ae52-c711d06bfe75 for instance 3cff7cce-773f-4500-af5d-a369509ca64f on hv-cinder-85070 Jul 21 23:47:47.809208 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-d29a9930-dfd6-4ca1-905b-8b2892053745 req-2a46254e-56c0-4c1f-a48f-45f5351c7082 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030033 Jul 21 23:47:47.809878 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 482/1003] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:48:03.813422 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0192fd95-5969-4add-9139-0d0c7b1ce52c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:03.813957 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0192fd95-5969-4add-9139-0d0c7b1ce52c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:03.816369 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=31 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:03.817034 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=7 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:03.822916 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0192fd95-5969-4add-9139-0d0c7b1ce52c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:03.823362 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0192fd95-5969-4add-9139-0d0c7b1ce52c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:03.824119 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0192fd95-5969-4add-9139-0d0c7b1ce52c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:03.824549 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0192fd95-5969-4add-9139-0d0c7b1ce52c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:03.905076 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-0192fd95-5969-4add-9139-0d0c7b1ce52c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lazy-loading 'services' on Instance uuid fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:48:03.976814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0192fd95-5969-4add-9139-0d0c7b1ce52c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65/os-volume_attachments/9bf00f50-eb68-4d83-868a-936a032f3ef9" status: 202 len: 0 microversion: 2.1 time: 0.167721 Jul 21 23:48:03.977717 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 522/1004] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:48:03 2022] DELETE /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65/os-volume_attachments/9bf00f50-eb68-4d83-868a-936a032f3ef9 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:48:05.091577 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=27 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:05.092952 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=79 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:05.098620 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5a4b5b8b-cc31-4c0a-99bd-a5568db9016e tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:05.099619 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5a4b5b8b-cc31-4c0a-99bd-a5568db9016e tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:05.107177 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a4b5b8b-cc31-4c0a-99bd-a5568db9016e tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:05.107884 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a4b5b8b-cc31-4c0a-99bd-a5568db9016e tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:05.109322 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a4b5b8b-cc31-4c0a-99bd-a5568db9016e tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:05.110712 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5a4b5b8b-cc31-4c0a-99bd-a5568db9016e tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:05.136659 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5a4b5b8b-cc31-4c0a-99bd-a5568db9016e tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:48:05.212572 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5a4b5b8b-cc31-4c0a-99bd-a5568db9016e tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 204 len: 0 microversion: 2.1 time: 0.122769 Jul 21 23:48:05.213573 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 483/1005] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:48:05 2022] DELETE /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:48:05.223276 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2b4f63f5-5557-4b42-81b0-bd04fb52a309 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:05.223992 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2b4f63f5-5557-4b42-81b0-bd04fb52a309 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:05.230187 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b4f63f5-5557-4b42-81b0-bd04fb52a309 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:05.230625 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b4f63f5-5557-4b42-81b0-bd04fb52a309 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:05.231379 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b4f63f5-5557-4b42-81b0-bd04fb52a309 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:05.231809 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2b4f63f5-5557-4b42-81b0-bd04fb52a309 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:05.365694 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-2b4f63f5-5557-4b42-81b0-bd04fb52a309 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:05.373136 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2b4f63f5-5557-4b42-81b0-bd04fb52a309 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1514 microversion: 2.1 time: 0.154794 Jul 21 23:48:05.373725 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 523/1006] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:05 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:06.392401 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-d854a547-5f6c-4ea9-865d-70c25a7c3f14 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:06.393005 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-d854a547-5f6c-4ea9-865d-70c25a7c3f14 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:06.399401 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d854a547-5f6c-4ea9-865d-70c25a7c3f14 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:06.399841 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d854a547-5f6c-4ea9-865d-70c25a7c3f14 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:06.400592 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d854a547-5f6c-4ea9-865d-70c25a7c3f14 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:06.401021 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-d854a547-5f6c-4ea9-865d-70c25a7c3f14 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:06.533715 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-d854a547-5f6c-4ea9-865d-70c25a7c3f14 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:06.541166 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-d854a547-5f6c-4ea9-865d-70c25a7c3f14 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1514 microversion: 2.1 time: 0.154049 Jul 21 23:48:06.541779 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 484/1007] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:06 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:07.529064 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-6a07cf7f-ad9e-423b-9ec5-e1e65517fef0 req-7986b50b-b264-4d41-b603-60f2fe97df6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65", "name": "network-vif-deleted", "tag": "6c438e91-9c68-4eb6-b549-d7b1b444cfa3"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:48:07.538961 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-6a07cf7f-ad9e-423b-9ec5-e1e65517fef0 req-7986b50b-b264-4d41-b603-60f2fe97df6d service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:07.539398 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-6a07cf7f-ad9e-423b-9ec5-e1e65517fef0 req-7986b50b-b264-4d41-b603-60f2fe97df6d service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:07.551620 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-6a07cf7f-ad9e-423b-9ec5-e1e65517fef0 req-7986b50b-b264-4d41-b603-60f2fe97df6d service nova] Creating event network-vif-deleted:6c438e91-9c68-4eb6-b549-d7b1b444cfa3 for instance fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 on hv-cinder-85070 Jul 21 23:48:07.556900 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-6a07cf7f-ad9e-423b-9ec5-e1e65517fef0 req-7986b50b-b264-4d41-b603-60f2fe97df6d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031960 Jul 21 23:48:07.557539 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 524/1008] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:48:07.559026 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3048d2b9-8b48-4b9b-8751-9849457e52bc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:07.559819 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3048d2b9-8b48-4b9b-8751-9849457e52bc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:07.568100 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3048d2b9-8b48-4b9b-8751-9849457e52bc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:07.568648 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3048d2b9-8b48-4b9b-8751-9849457e52bc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:07.569539 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3048d2b9-8b48-4b9b-8751-9849457e52bc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:07.570069 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3048d2b9-8b48-4b9b-8751-9849457e52bc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:07.638154 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-3048d2b9-8b48-4b9b-8751-9849457e52bc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:07.646144 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3048d2b9-8b48-4b9b-8751-9849457e52bc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 200 len: 1304 microversion: 2.1 time: 0.091506 Jul 21 23:48:07.647039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 485/1009] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:07 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:08.665357 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2af658a5-cd59-4204-8c4c-70a883e36a1c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:08.666054 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-2af658a5-cd59-4204-8c4c-70a883e36a1c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:08.672263 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2af658a5-cd59-4204-8c4c-70a883e36a1c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:08.672727 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2af658a5-cd59-4204-8c4c-70a883e36a1c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:08.673577 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2af658a5-cd59-4204-8c4c-70a883e36a1c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:08.674009 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-2af658a5-cd59-4204-8c4c-70a883e36a1c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:08.686890 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-2af658a5-cd59-4204-8c4c-70a883e36a1c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] HTTP exception thrown: Instance fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 could not be found. Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2af658a5-cd59-4204-8c4c-70a883e36a1c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Request method failure captured: Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 HTTP/1.1 Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eWBWhMGUUGWlTUA9zpKJGgAQ9mchU6YQMLyAyesfdHzffI-kKacSjQcyBQDZkcAGA7KweHoSwUCj8QqildH2aJXJQj-3RzzgtVkKmJocUrqjsjNX5JiJqYV8hm2mYCjS0raB54DmQLz2HxrPW91rR3UjI-xPFK4ruZ3yP4VmjlWhnM Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 1f9a96f2aec2463e9cab476cb103b93a Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesSnapshotTestJSON-74850306 Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:48:08.689018 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1f9a96f2aec2463e9cab476cb103b93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1f9a96f2aec2463e9cab476cb103b93a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1f9a96f2aec2463e9cab476cb103b93a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1f9a96f2aec2463e9cab476cb103b93a"}]}] Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesSnapshotTestJSON-74850306 Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 1f9a96f2aec2463e9cab476cb103b93a Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-74850306 Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesSnapshotTestJSON-74850306-project Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: be644b899ffe419485aac64510542000 Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesSnapshotTestJSON-74850306-project Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 could not be found. Jul 21 23:48:08.690764 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65'} Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 could not be found. Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:48:08.691814 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 could not be found. Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 could not be found. Jul 21 23:48:08.693146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:48:08.694375 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-2af658a5-cd59-4204-8c4c-70a883e36a1c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Returning 404 to user: Instance fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:48:08.694375 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-2af658a5-cd59-4204-8c4c-70a883e36a1c tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65" status: 404 len: 111 microversion: 2.1 time: 0.029811 Jul 21 23:48:08.694375 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 525/1010] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:08 2022] GET /compute/v2.1/servers/fb2cd63f-fb87-4d0d-b5fc-e89a4fab6c65 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:48:17.470238 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1726120130", "imageRef": "8b7c1855-07a7-4d38-a3e0-5f1bf4947a47", "flavorRef": "452", "networks": [{"uuid": "9aaa1874-713b-419b-9d7f-bbc12b367aa3"}]}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:48:17.521969 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.network.neutron [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] validate_networks() for [('9aaa1874-713b-419b-9d7f-bbc12b367aa3', None, None, None, None, None)] {{(pid=124387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:48:17.647430 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:17.863114 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Flavor limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:48:17.863538 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Image limits 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:48:17.864016 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Flavor pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:48:17.864423 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Image pref 0:0:0 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:48:17.864835 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.virt.hardware [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:48:17.873525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:17.873975 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:17.874770 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:17.875204 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:17.893061 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Getting quotas for project 1f9a96f2aec2463e9cab476cb103b93a. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:48:17.896958 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.quota [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Getting quotas for user be644b899ffe419485aac64510542000 and project 1f9a96f2aec2463e9cab476cb103b93a. Resources: {'cores', 'instances', 'ram'} {{(pid=124387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:48:17.908527 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Going to run 1 instances... {{(pid=124387) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:48:17.910877 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b7c1855-07a7-4d38-a3e0-5f1bf4947a47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:48:17.957602 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-901fe28c-0fc0-4b42-b668-4004163fafb2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491006 Jul 21 23:48:17.958269 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 486/1011] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 23:48:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:48:17.968713 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-e1c325ff-67fb-4a8d-b51a-1addc47bf90f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:17.969404 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-e1c325ff-67fb-4a8d-b51a-1addc47bf90f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:18.026258 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-e1c325ff-67fb-4a8d-b51a-1addc47bf90f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:18.034545 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-e1c325ff-67fb-4a8d-b51a-1addc47bf90f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1219 microversion: 2.1 time: 0.070303 Jul 21 23:48:18.035425 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 526/1012] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:17 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:19.052516 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8f826f68-4b8c-4d88-b3fe-3cd3884b4fde tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:19.053128 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8f826f68-4b8c-4d88-b3fe-3cd3884b4fde tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:19.059419 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8f826f68-4b8c-4d88-b3fe-3cd3884b4fde tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:19.060006 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8f826f68-4b8c-4d88-b3fe-3cd3884b4fde tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:19.061005 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8f826f68-4b8c-4d88-b3fe-3cd3884b4fde tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:19.061478 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8f826f68-4b8c-4d88-b3fe-3cd3884b4fde tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:19.156530 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-8f826f68-4b8c-4d88-b3fe-3cd3884b4fde tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:19.164692 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8f826f68-4b8c-4d88-b3fe-3cd3884b4fde tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1277 microversion: 2.1 time: 0.116758 Jul 21 23:48:19.165272 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 487/1013] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:19 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:20.136094 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-e06a8d1d-96bc-4388-8339-4323921fe682 req-5266ed86-5515-4140-8035-b118c18a8a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4741fda-d375-4841-b222-39f9ab397864", "tag": "1b8aa281-0e1d-44fd-b693-d8d5e873a1db"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:48:20.141372 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:20.150428 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e06a8d1d-96bc-4388-8339-4323921fe682 req-5266ed86-5515-4140-8035-b118c18a8a85 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:20.150878 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-e06a8d1d-96bc-4388-8339-4323921fe682 req-5266ed86-5515-4140-8035-b118c18a8a85 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:20.162731 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-e06a8d1d-96bc-4388-8339-4323921fe682 req-5266ed86-5515-4140-8035-b118c18a8a85 service nova] Creating event network-changed:1b8aa281-0e1d-44fd-b693-d8d5e873a1db for instance d4741fda-d375-4841-b222-39f9ab397864 on hv-cinder-85070 Jul 21 23:48:20.167615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-e06a8d1d-96bc-4388-8339-4323921fe682 req-5266ed86-5515-4140-8035-b118c18a8a85 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036183 Jul 21 23:48:20.168282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 527/1014] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:48:20.182427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-4032ed1a-55ed-44c7-b759-92a4b535932d tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:20.183039 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-4032ed1a-55ed-44c7-b759-92a4b535932d tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:20.190276 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4032ed1a-55ed-44c7-b759-92a4b535932d tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:20.190723 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4032ed1a-55ed-44c7-b759-92a4b535932d tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:20.191484 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4032ed1a-55ed-44c7-b759-92a4b535932d tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:20.191915 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-4032ed1a-55ed-44c7-b759-92a4b535932d tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:20.669501 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-4032ed1a-55ed-44c7-b759-92a4b535932d tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:20.677327 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-4032ed1a-55ed-44c7-b759-92a4b535932d tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1319 microversion: 2.1 time: 0.498721 Jul 21 23:48:20.677961 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 488/1015] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:20 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:21.696335 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ee973b06-552b-4864-94df-1c889e7d7416 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:21.697031 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ee973b06-552b-4864-94df-1c889e7d7416 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:21.703184 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee973b06-552b-4864-94df-1c889e7d7416 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:21.703629 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee973b06-552b-4864-94df-1c889e7d7416 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:21.705049 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee973b06-552b-4864-94df-1c889e7d7416 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:21.705506 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ee973b06-552b-4864-94df-1c889e7d7416 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:21.835788 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ee973b06-552b-4864-94df-1c889e7d7416 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:21.843225 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ee973b06-552b-4864-94df-1c889e7d7416 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1319 microversion: 2.1 time: 0.151606 Jul 21 23:48:21.843790 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 528/1016] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:21 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:48:22.862235 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-2381919e-439e-4252-ba70-1cc57571d0b4 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:22.862848 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-2381919e-439e-4252-ba70-1cc57571d0b4 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:22.869364 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2381919e-439e-4252-ba70-1cc57571d0b4 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:22.869816 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2381919e-439e-4252-ba70-1cc57571d0b4 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:22.870575 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2381919e-439e-4252-ba70-1cc57571d0b4 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:22.871014 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-2381919e-439e-4252-ba70-1cc57571d0b4 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:22.998978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-2381919e-439e-4252-ba70-1cc57571d0b4 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:23.007052 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-2381919e-439e-4252-ba70-1cc57571d0b4 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1319 microversion: 2.1 time: 0.149467 Jul 21 23:48:23.007609 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 489/1017] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:22 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:24.023876 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-3fb40318-ed2a-44c3-9a68-fbf000e676c9 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:24.024480 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-3fb40318-ed2a-44c3-9a68-fbf000e676c9 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:24.030963 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3fb40318-ed2a-44c3-9a68-fbf000e676c9 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:24.031403 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3fb40318-ed2a-44c3-9a68-fbf000e676c9 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:24.032160 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3fb40318-ed2a-44c3-9a68-fbf000e676c9 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:24.032762 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-3fb40318-ed2a-44c3-9a68-fbf000e676c9 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:24.166938 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-3fb40318-ed2a-44c3-9a68-fbf000e676c9 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:24.175344 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-3fb40318-ed2a-44c3-9a68-fbf000e676c9 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1319 microversion: 2.1 time: 0.155363 Jul 21 23:48:24.175904 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 529/1018] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:24 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:25.192838 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1d256fb8-6516-4480-ad27-9c22afb4d550 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:25.193470 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-1d256fb8-6516-4480-ad27-9c22afb4d550 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:25.200167 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1d256fb8-6516-4480-ad27-9c22afb4d550 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:25.200612 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1d256fb8-6516-4480-ad27-9c22afb4d550 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:25.201397 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1d256fb8-6516-4480-ad27-9c22afb4d550 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:25.201830 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-1d256fb8-6516-4480-ad27-9c22afb4d550 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:25.335370 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-1d256fb8-6516-4480-ad27-9c22afb4d550 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:25.343025 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1d256fb8-6516-4480-ad27-9c22afb4d550 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1319 microversion: 2.1 time: 0.154546 Jul 21 23:48:25.343582 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 490/1019] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:25 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:25.816455 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-42049e37-78fe-4116-9107-ec1a0ad7bbd6 req-74a30766-d91e-4e35-a731-a75d2c20ed7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4741fda-d375-4841-b222-39f9ab397864", "name": "network-vif-plugged", "status": "completed", "tag": "1b8aa281-0e1d-44fd-b693-d8d5e873a1db"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:48:25.825249 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-42049e37-78fe-4116-9107-ec1a0ad7bbd6 req-74a30766-d91e-4e35-a731-a75d2c20ed7d service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:25.825702 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-42049e37-78fe-4116-9107-ec1a0ad7bbd6 req-74a30766-d91e-4e35-a731-a75d2c20ed7d service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:25.839665 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-42049e37-78fe-4116-9107-ec1a0ad7bbd6 req-74a30766-d91e-4e35-a731-a75d2c20ed7d service nova] Creating event network-vif-plugged:1b8aa281-0e1d-44fd-b693-d8d5e873a1db for instance d4741fda-d375-4841-b222-39f9ab397864 on hv-cinder-85070 Jul 21 23:48:25.844536 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-42049e37-78fe-4116-9107-ec1a0ad7bbd6 req-74a30766-d91e-4e35-a731-a75d2c20ed7d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032199 Jul 21 23:48:25.846400 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 530/1020] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:48:26.361173 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-cd36e45f-34bd-448b-9955-6abbcdb88d08 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:26.361815 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-cd36e45f-34bd-448b-9955-6abbcdb88d08 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:26.368219 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd36e45f-34bd-448b-9955-6abbcdb88d08 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:26.368664 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd36e45f-34bd-448b-9955-6abbcdb88d08 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:26.369466 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd36e45f-34bd-448b-9955-6abbcdb88d08 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:26.369903 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-cd36e45f-34bd-448b-9955-6abbcdb88d08 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:26.504050 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-cd36e45f-34bd-448b-9955-6abbcdb88d08 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:26.511644 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-cd36e45f-34bd-448b-9955-6abbcdb88d08 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1319 microversion: 2.1 time: 0.155493 Jul 21 23:48:26.512240 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 491/1021] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:26 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:27.529136 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-c5c20a18-5563-422f-927a-db80e87fd40f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:27.529853 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-c5c20a18-5563-422f-927a-db80e87fd40f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:27.536914 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c5c20a18-5563-422f-927a-db80e87fd40f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:27.537398 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c5c20a18-5563-422f-927a-db80e87fd40f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:27.538154 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c5c20a18-5563-422f-927a-db80e87fd40f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:27.538619 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-c5c20a18-5563-422f-927a-db80e87fd40f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:27.669339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-c5c20a18-5563-422f-927a-db80e87fd40f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:27.677606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-c5c20a18-5563-422f-927a-db80e87fd40f tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1508 microversion: 2.1 time: 0.153199 Jul 21 23:48:27.678232 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 531/1022] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:27 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:27.693906 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-00a0e624-5860-405c-8fac-29b24259bea2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d9d9808-0b24-46eb-b71e-609236a3bb8f", "device": "/dev/sdb"}} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:48:27.695543 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-00a0e624-5860-405c-8fac-29b24259bea2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:27.701991 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-00a0e624-5860-405c-8fac-29b24259bea2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:27.702441 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-00a0e624-5860-405c-8fac-29b24259bea2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:27.703200 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-00a0e624-5860-405c-8fac-29b24259bea2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:27.703633 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-00a0e624-5860-405c-8fac-29b24259bea2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:27.884909 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=2 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:27.903058 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell0:SELECT=6 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:27.931183 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-00a0e624-5860-405c-8fac-29b24259bea2 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "POST /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240849 Jul 21 23:48:27.931784 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 492/1023] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 23:48:27 2022] POST /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:48:46.172479 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-a53ab64a-deb7-4f4c-9b74-569fdf25337a tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:46.173726 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-a53ab64a-deb7-4f4c-9b74-569fdf25337a tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:46.175719 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell0:SELECT=2 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:46.176978 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_api:SELECT=22 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:46.177768 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG dbcounter [-] [124388] Writing DB stats nova_cell1:SELECT=22 {{(pid=124388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:46.184188 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a53ab64a-deb7-4f4c-9b74-569fdf25337a tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:46.184636 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a53ab64a-deb7-4f4c-9b74-569fdf25337a tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:46.185431 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a53ab64a-deb7-4f4c-9b74-569fdf25337a tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:46.185864 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-a53ab64a-deb7-4f4c-9b74-569fdf25337a tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:46.321167 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.objects.instance [None req-a53ab64a-deb7-4f4c-9b74-569fdf25337a tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lazy-loading 'services' on Instance uuid d4741fda-d375-4841-b222-39f9ab397864 {{(pid=124388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:48:46.390471 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-a53ab64a-deb7-4f4c-9b74-569fdf25337a tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864/os-volume_attachments/1d9d9808-0b24-46eb-b71e-609236a3bb8f" status: 202 len: 0 microversion: 2.1 time: 0.221770 Jul 21 23:48:46.391044 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 532/1024] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 23:48:46 2022] DELETE /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864/os-volume_attachments/1d9d9808-0b24-46eb-b71e-609236a3bb8f => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:48:47.503624 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-41e98db8-c342-48ce-9e8c-ed9c7fb0baf3 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:47.504268 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-41e98db8-c342-48ce-9e8c-ed9c7fb0baf3 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:47.506682 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:47.507662 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:47.514266 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-41e98db8-c342-48ce-9e8c-ed9c7fb0baf3 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:47.514705 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-41e98db8-c342-48ce-9e8c-ed9c7fb0baf3 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:47.515498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-41e98db8-c342-48ce-9e8c-ed9c7fb0baf3 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:47.515930 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-41e98db8-c342-48ce-9e8c-ed9c7fb0baf3 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:47.546164 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-41e98db8-c342-48ce-9e8c-ed9c7fb0baf3 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:48:47.620180 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-41e98db8-c342-48ce-9e8c-ed9c7fb0baf3 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 204 len: 0 microversion: 2.1 time: 0.121506 Jul 21 23:48:47.620869 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 493/1025] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:48:47 2022] DELETE /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:48:47.630956 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-edc1e6d7-abb2-4b90-b320-329184061656 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:47.631657 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-edc1e6d7-abb2-4b90-b320-329184061656 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:47.637830 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-edc1e6d7-abb2-4b90-b320-329184061656 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:47.638271 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-edc1e6d7-abb2-4b90-b320-329184061656 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:47.639029 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-edc1e6d7-abb2-4b90-b320-329184061656 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:47.639462 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-edc1e6d7-abb2-4b90-b320-329184061656 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:47.770406 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-edc1e6d7-abb2-4b90-b320-329184061656 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:47.777798 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-edc1e6d7-abb2-4b90-b320-329184061656 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1514 microversion: 2.1 time: 0.152486 Jul 21 23:48:47.778358 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 533/1026] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:47 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:48.040522 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:48:48.040788 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Thu Jul 21 23:48:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:48:48.536235 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8a39da9e-175c-4355-b6f0-8fec4030cbb3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:48.536894 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8a39da9e-175c-4355-b6f0-8fec4030cbb3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:48.538356 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-4ace8546-84cf-4bb1-a675-55bab7621ed8 req-e7704ada-3b7b-4bea-8e6c-93490398d4ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a7c2ac-d9f2-4d30-9522-c4988512764c", "tag": "c7e76131-2329-43d4-94e0-0bb4e5b2956f"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:48:48.543882 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8a39da9e-175c-4355-b6f0-8fec4030cbb3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:48.544427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8a39da9e-175c-4355-b6f0-8fec4030cbb3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:48.545308 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8a39da9e-175c-4355-b6f0-8fec4030cbb3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:48.545819 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-8a39da9e-175c-4355-b6f0-8fec4030cbb3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:48.546437 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4ace8546-84cf-4bb1-a675-55bab7621ed8 req-e7704ada-3b7b-4bea-8e6c-93490398d4ab service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:48.546874 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-4ace8546-84cf-4bb1-a675-55bab7621ed8 req-e7704ada-3b7b-4bea-8e6c-93490398d4ab service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:48.559488 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-4ace8546-84cf-4bb1-a675-55bab7621ed8 req-e7704ada-3b7b-4bea-8e6c-93490398d4ab service nova] Creating event network-changed:c7e76131-2329-43d4-94e0-0bb4e5b2956f for instance 14a7c2ac-d9f2-4d30-9522-c4988512764c on hv-cinder-85070 Jul 21 23:48:48.566926 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-4ace8546-84cf-4bb1-a675-55bab7621ed8 req-e7704ada-3b7b-4bea-8e6c-93490398d4ab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032215 Jul 21 23:48:48.567837 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 534/1027] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:48:48.573312 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-8a39da9e-175c-4355-b6f0-8fec4030cbb3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:48:48.648697 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8a39da9e-175c-4355-b6f0-8fec4030cbb3 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "DELETE /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 204 len: 0 microversion: 2.1 time: 0.117057 Jul 21 23:48:48.649220 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 494/1028] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:48:48 2022] DELETE /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:48:48.659724 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-88ef5d17-4f6e-4ae7-bbe5-be1fb9bd3093 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:48.660526 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-88ef5d17-4f6e-4ae7-bbe5-be1fb9bd3093 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:48.666828 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-88ef5d17-4f6e-4ae7-bbe5-be1fb9bd3093 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:48.667339 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-88ef5d17-4f6e-4ae7-bbe5-be1fb9bd3093 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:48.668220 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-88ef5d17-4f6e-4ae7-bbe5-be1fb9bd3093 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:48.668711 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-88ef5d17-4f6e-4ae7-bbe5-be1fb9bd3093 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:48.797466 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-eaa7af96-3e55-47fa-8a41-eb78bcb9c2dc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:48.799626 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-eaa7af96-3e55-47fa-8a41-eb78bcb9c2dc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:48.805821 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-eaa7af96-3e55-47fa-8a41-eb78bcb9c2dc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:48.806267 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-eaa7af96-3e55-47fa-8a41-eb78bcb9c2dc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:48.807032 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-eaa7af96-3e55-47fa-8a41-eb78bcb9c2dc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:48.807461 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-eaa7af96-3e55-47fa-8a41-eb78bcb9c2dc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:48.810977 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-88ef5d17-4f6e-4ae7-bbe5-be1fb9bd3093 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:48.819570 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-88ef5d17-4f6e-4ae7-bbe5-be1fb9bd3093 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1579 microversion: 2.1 time: 0.165898 Jul 21 23:48:48.820310 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 535/1029] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:48 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:49.040305 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-eaa7af96-3e55-47fa-8a41-eb78bcb9c2dc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:49.048978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-eaa7af96-3e55-47fa-8a41-eb78bcb9c2dc tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1514 microversion: 2.1 time: 0.255665 Jul 21 23:48:49.049584 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 495/1030] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:48 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1514 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:48:49.836623 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5decf3e9-7b3f-4e65-bc3e-eb7e568158f1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:49.837163 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5decf3e9-7b3f-4e65-bc3e-eb7e568158f1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:49.843673 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5decf3e9-7b3f-4e65-bc3e-eb7e568158f1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:49.844124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5decf3e9-7b3f-4e65-bc3e-eb7e568158f1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:49.845010 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5decf3e9-7b3f-4e65-bc3e-eb7e568158f1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:49.845582 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5decf3e9-7b3f-4e65-bc3e-eb7e568158f1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:49.978438 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-5decf3e9-7b3f-4e65-bc3e-eb7e568158f1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:49.986245 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5decf3e9-7b3f-4e65-bc3e-eb7e568158f1 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1579 microversion: 2.1 time: 0.153561 Jul 21 23:48:49.986804 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 536/1031] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:49 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:50.066497 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-7e917596-ce74-42c2-99f5-b339912aca03 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:50.067110 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-7e917596-ce74-42c2-99f5-b339912aca03 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:50.074157 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7e917596-ce74-42c2-99f5-b339912aca03 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:50.074611 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7e917596-ce74-42c2-99f5-b339912aca03 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:50.075377 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7e917596-ce74-42c2-99f5-b339912aca03 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:50.075816 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-7e917596-ce74-42c2-99f5-b339912aca03 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:50.283361 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-7e917596-ce74-42c2-99f5-b339912aca03 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:50.290933 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-7e917596-ce74-42c2-99f5-b339912aca03 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1514 microversion: 2.1 time: 0.229730 Jul 21 23:48:50.291504 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 496/1032] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:50 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:51.003564 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-b2ad5453-8270-4eef-812c-b6fb748eefe6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:51.004120 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-b2ad5453-8270-4eef-812c-b6fb748eefe6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:51.010681 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2ad5453-8270-4eef-812c-b6fb748eefe6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:51.011117 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2ad5453-8270-4eef-812c-b6fb748eefe6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:51.011894 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2ad5453-8270-4eef-812c-b6fb748eefe6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:51.012334 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-b2ad5453-8270-4eef-812c-b6fb748eefe6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:51.153146 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-b2ad5453-8270-4eef-812c-b6fb748eefe6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:51.161667 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-b2ad5453-8270-4eef-812c-b6fb748eefe6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1579 microversion: 2.1 time: 0.162114 Jul 21 23:48:51.162239 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 537/1033] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:50 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:51.308791 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-5089c5a6-cb56-40d2-a0a3-f4c747ca81e7 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:51.309372 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-5089c5a6-cb56-40d2-a0a3-f4c747ca81e7 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:51.316389 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5089c5a6-cb56-40d2-a0a3-f4c747ca81e7 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:51.316837 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5089c5a6-cb56-40d2-a0a3-f4c747ca81e7 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:51.317647 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5089c5a6-cb56-40d2-a0a3-f4c747ca81e7 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:51.318082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-5089c5a6-cb56-40d2-a0a3-f4c747ca81e7 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:51.670807 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-5089c5a6-cb56-40d2-a0a3-f4c747ca81e7 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be644b899ffe419485aac64510542000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9a96f2aec2463e9cab476cb103b93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:51.678602 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-5089c5a6-cb56-40d2-a0a3-f4c747ca81e7 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 200 len: 1514 microversion: 2.1 time: 0.373732 Jul 21 23:48:51.679288 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 497/1034] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:51 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 1514 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:51.704801 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-59e6edfc-c7e1-41c3-b8b9-c6e5b1ad8dea req-a30ef43b-6e45-4753-912f-5a09c31cc8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4741fda-d375-4841-b222-39f9ab397864", "name": "network-vif-deleted", "tag": "1b8aa281-0e1d-44fd-b693-d8d5e873a1db"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:48:51.713860 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-59e6edfc-c7e1-41c3-b8b9-c6e5b1ad8dea req-a30ef43b-6e45-4753-912f-5a09c31cc8db service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:51.714400 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-59e6edfc-c7e1-41c3-b8b9-c6e5b1ad8dea req-a30ef43b-6e45-4753-912f-5a09c31cc8db service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:51.726994 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-59e6edfc-c7e1-41c3-b8b9-c6e5b1ad8dea req-a30ef43b-6e45-4753-912f-5a09c31cc8db service nova] Creating event network-vif-deleted:1b8aa281-0e1d-44fd-b693-d8d5e873a1db for instance d4741fda-d375-4841-b222-39f9ab397864 on hv-cinder-85070 Jul 21 23:48:51.732046 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-59e6edfc-c7e1-41c3-b8b9-c6e5b1ad8dea req-a30ef43b-6e45-4753-912f-5a09c31cc8db service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031460 Jul 21 23:48:51.732887 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 538/1035] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:48:52.182320 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-462aba30-94ba-437f-9863-d07152914483 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:52.183340 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-462aba30-94ba-437f-9863-d07152914483 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:52.191954 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-462aba30-94ba-437f-9863-d07152914483 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:52.193347 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-462aba30-94ba-437f-9863-d07152914483 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:52.194406 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-462aba30-94ba-437f-9863-d07152914483 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:52.195074 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-462aba30-94ba-437f-9863-d07152914483 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:52.270758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-462aba30-94ba-437f-9863-d07152914483 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:52.278443 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-462aba30-94ba-437f-9863-d07152914483 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 200 len: 1226 microversion: 2.1 time: 0.102012 Jul 21 23:48:52.279116 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 498/1036] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:52 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:48:52.696996 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-85ef0ddc-e323-47a6-a94e-df11044e9019 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:52.697711 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-85ef0ddc-e323-47a6-a94e-df11044e9019 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] [instance: d4741fda-d375-4841-b222-39f9ab397864] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:52.704258 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-85ef0ddc-e323-47a6-a94e-df11044e9019 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:52.704657 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-85ef0ddc-e323-47a6-a94e-df11044e9019 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:52.705662 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-85ef0ddc-e323-47a6-a94e-df11044e9019 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:52.706161 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-85ef0ddc-e323-47a6-a94e-df11044e9019 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:52.719685 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-85ef0ddc-e323-47a6-a94e-df11044e9019 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] HTTP exception thrown: Instance d4741fda-d375-4841-b222-39f9ab397864 could not be found. Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-85ef0ddc-e323-47a6-a94e-df11044e9019 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Request method failure captured: Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 HTTP/1.1 Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eWBWhMGUUGWlTUA9zpKJGgAQ9mchU6YQMLyAyesfdHzffI-kKacSjQcyBQDZkcAGA7KweHoSwUCj8QqildH2aJXJQj-3RzzgtVkKmJocUrqjsjNX5JiJqYV8hm2mYCjS0raB54DmQLz2HxrPW91rR3UjI-xPFK4ruZ3yP4VmjlWhnM Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 1f9a96f2aec2463e9cab476cb103b93a Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-VolumesSnapshotTestJSON-74850306 Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:48:52.721613 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1f9a96f2aec2463e9cab476cb103b93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1f9a96f2aec2463e9cab476cb103b93a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1f9a96f2aec2463e9cab476cb103b93a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1f9a96f2aec2463e9cab476cb103b93a"}]}] Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-VolumesSnapshotTestJSON-74850306 Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 1f9a96f2aec2463e9cab476cb103b93a Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-74850306 Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-VolumesSnapshotTestJSON-74850306-project Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: be644b899ffe419485aac64510542000 Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-VolumesSnapshotTestJSON-74850306-project Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance d4741fda-d375-4841-b222-39f9ab397864 could not be found. Jul 21 23:48:52.723294 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'd4741fda-d375-4841-b222-39f9ab397864'} Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4741fda-d375-4841-b222-39f9ab397864 could not be found. Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:48:52.724124 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4741fda-d375-4841-b222-39f9ab397864 could not be found. Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4741fda-d375-4841-b222-39f9ab397864 could not be found. Jul 21 23:48:52.725495 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:48:52.726657 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-85ef0ddc-e323-47a6-a94e-df11044e9019 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] Returning 404 to user: Instance d4741fda-d375-4841-b222-39f9ab397864 could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:48:52.726657 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-85ef0ddc-e323-47a6-a94e-df11044e9019 tempest-VolumesSnapshotTestJSON-74850306 tempest-VolumesSnapshotTestJSON-74850306-project] 10.222.0.57 "GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864" status: 404 len: 111 microversion: 2.1 time: 0.030741 Jul 21 23:48:52.726657 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 539/1037] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:52 2022] GET /compute/v2.1/servers/d4741fda-d375-4841-b222-39f9ab397864 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:48:53.296410 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-65373156-e0cb-48c1-bb97-f8ea1a0f5a89 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:53.297022 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-65373156-e0cb-48c1-bb97-f8ea1a0f5a89 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 14a7c2ac-d9f2-4d30-9522-c4988512764c] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:53.304054 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-65373156-e0cb-48c1-bb97-f8ea1a0f5a89 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:53.304498 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-65373156-e0cb-48c1-bb97-f8ea1a0f5a89 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:53.305288 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-65373156-e0cb-48c1-bb97-f8ea1a0f5a89 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:53.305723 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-65373156-e0cb-48c1-bb97-f8ea1a0f5a89 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:53.319228 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-65373156-e0cb-48c1-bb97-f8ea1a0f5a89 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] HTTP exception thrown: Instance 14a7c2ac-d9f2-4d30-9522-c4988512764c could not be found. Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-65373156-e0cb-48c1-bb97-f8ea1a0f5a89 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Request method failure captured: Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c HTTP/1.1 Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eQDE4Bn1yVu8ksFRIZBWG5R-YqOf9RgdQBoDwsU44y8eTTeU_CWYGBiTUkd6sacxyPTXC9Tnax0ACzxTFyuNjDPlakcdJvVEe6Lm9TwbVbPCWLouUCte_pIPg91BDb1Nh623cefKvBmm85DXJVLisSRxFRy-rf4q1BX2EBaHWeDJFM Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 44fb74dd337c49a898397e3482e4305d Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-TestVolumeBootPattern-57714340 Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:48:53.320832 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44fb74dd337c49a898397e3482e4305d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/44fb74dd337c49a898397e3482e4305d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_44fb74dd337c49a898397e3482e4305d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44fb74dd337c49a898397e3482e4305d"}]}] Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-TestVolumeBootPattern-57714340 Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 44fb74dd337c49a898397e3482e4305d Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-TestVolumeBootPattern-57714340 Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-TestVolumeBootPattern-57714340-project Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 26738ea4f6d54d7d81f1ec5057c237ff Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-TestVolumeBootPattern-57714340-project Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance 14a7c2ac-d9f2-4d30-9522-c4988512764c could not be found. Jul 21 23:48:53.322454 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': '14a7c2ac-d9f2-4d30-9522-c4988512764c'} Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a7c2ac-d9f2-4d30-9522-c4988512764c could not be found. Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:48:53.323295 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a7c2ac-d9f2-4d30-9522-c4988512764c could not be found. Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a7c2ac-d9f2-4d30-9522-c4988512764c could not be found. Jul 21 23:48:53.324758 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:48:53.326105 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-65373156-e0cb-48c1-bb97-f8ea1a0f5a89 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Returning 404 to user: Instance 14a7c2ac-d9f2-4d30-9522-c4988512764c could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:48:53.326105 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-65373156-e0cb-48c1-bb97-f8ea1a0f5a89 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c" status: 404 len: 111 microversion: 2.1 time: 0.029875 Jul 21 23:48:53.326105 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 499/1038] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:53 2022] GET /compute/v2.1/servers/14a7c2ac-d9f2-4d30-9522-c4988512764c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:48:53.748306 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-066b88dc-9ec0-438a-8497-88e3b1cd07ce req-46fae7ae-3e0f-4b32-a69d-9e0db459f9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a7c2ac-d9f2-4d30-9522-c4988512764c", "name": "network-vif-deleted", "tag": "c7e76131-2329-43d4-94e0-0bb4e5b2956f"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:48:53.756755 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-066b88dc-9ec0-438a-8497-88e3b1cd07ce req-46fae7ae-3e0f-4b32-a69d-9e0db459f9ff service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:53.757210 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-066b88dc-9ec0-438a-8497-88e3b1cd07ce req-46fae7ae-3e0f-4b32-a69d-9e0db459f9ff service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:53.768011 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-066b88dc-9ec0-438a-8497-88e3b1cd07ce req-46fae7ae-3e0f-4b32-a69d-9e0db459f9ff service nova] Creating event network-vif-deleted:c7e76131-2329-43d4-94e0-0bb4e5b2956f for instance 14a7c2ac-d9f2-4d30-9522-c4988512764c on hv-cinder-85070 Jul 21 23:48:53.772746 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-066b88dc-9ec0-438a-8497-88e3b1cd07ce req-46fae7ae-3e0f-4b32-a69d-9e0db459f9ff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028179 Jul 21 23:48:53.773360 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 540/1039] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:48:59.466817 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-3320b9d0-a254-4d9a-ae2c-eb911a0f28d8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:59.467361 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3320b9d0-a254-4d9a-ae2c-eb911a0f28d8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:59.471383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-8b83dc88-c4fb-46d7-8ddb-5dbb6c5d57d8 req-71608ba4-feca-4c33-abc0-913a65b0086a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d", "tag": "bbd9ba1f-d794-42e2-b153-64ef54f71175"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:48:59.474803 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3320b9d0-a254-4d9a-ae2c-eb911a0f28d8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:59.475242 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3320b9d0-a254-4d9a-ae2c-eb911a0f28d8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:59.476006 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3320b9d0-a254-4d9a-ae2c-eb911a0f28d8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:59.476432 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-3320b9d0-a254-4d9a-ae2c-eb911a0f28d8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:59.480344 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-8b83dc88-c4fb-46d7-8ddb-5dbb6c5d57d8 req-71608ba4-feca-4c33-abc0-913a65b0086a service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:59.481097 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-8b83dc88-c4fb-46d7-8ddb-5dbb6c5d57d8 req-71608ba4-feca-4c33-abc0-913a65b0086a service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:59.493165 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-8b83dc88-c4fb-46d7-8ddb-5dbb6c5d57d8 req-71608ba4-feca-4c33-abc0-913a65b0086a service nova] Creating event network-changed:bbd9ba1f-d794-42e2-b153-64ef54f71175 for instance 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d on hv-cinder-85070 Jul 21 23:48:59.498818 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-8b83dc88-c4fb-46d7-8ddb-5dbb6c5d57d8 req-71608ba4-feca-4c33-abc0-913a65b0086a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033451 Jul 21 23:48:59.499885 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 541/1040] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:48:59.505433 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-3320b9d0-a254-4d9a-ae2c-eb911a0f28d8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Going to try to terminate instance {{(pid=124387) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:48:59.602076 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-3320b9d0-a254-4d9a-ae2c-eb911a0f28d8 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 204 len: 0 microversion: 2.1 time: 0.139112 Jul 21 23:48:59.602955 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 500/1041] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:48:59 2022] DELETE /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:48:59.612788 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ca1b5636-9a83-49b6-a4fb-8fdc868e97f6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:48:59.613902 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ca1b5636-9a83-49b6-a4fb-8fdc868e97f6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:48:59.620623 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ca1b5636-9a83-49b6-a4fb-8fdc868e97f6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:59.621700 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ca1b5636-9a83-49b6-a4fb-8fdc868e97f6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:59.622097 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ca1b5636-9a83-49b6-a4fb-8fdc868e97f6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:48:59.622603 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ca1b5636-9a83-49b6-a4fb-8fdc868e97f6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:48:59.769086 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-ca1b5636-9a83-49b6-a4fb-8fdc868e97f6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:48:59.777794 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ca1b5636-9a83-49b6-a4fb-8fdc868e97f6 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1576 microversion: 2.1 time: 0.170181 Jul 21 23:48:59.778754 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 542/1042] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:48:59 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:49:00.796443 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-9f67034a-5fa7-4ed7-befe-44d233914b66 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:00.797138 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-9f67034a-5fa7-4ed7-befe-44d233914b66 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:49:00.804307 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9f67034a-5fa7-4ed7-befe-44d233914b66 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:00.804754 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9f67034a-5fa7-4ed7-befe-44d233914b66 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:00.805544 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9f67034a-5fa7-4ed7-befe-44d233914b66 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:00.805976 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-9f67034a-5fa7-4ed7-befe-44d233914b66 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:01.004066 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-9f67034a-5fa7-4ed7-befe-44d233914b66 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:49:01.018015 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-9f67034a-5fa7-4ed7-befe-44d233914b66 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1576 microversion: 2.1 time: 0.225709 Jul 21 23:49:01.018826 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 501/1043] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:49:00 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1576 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:49:01.665112 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-a9f6f107-1ce1-4df0-a38e-abdb4942ee72 req-6ebaa41d-48e9-47a8-b72c-522980d126b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d", "name": "network-vif-deleted", "tag": "bbd9ba1f-d794-42e2-b153-64ef54f71175"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:49:01.677100 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-a9f6f107-1ce1-4df0-a38e-abdb4942ee72 req-6ebaa41d-48e9-47a8-b72c-522980d126b2 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:01.677556 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-a9f6f107-1ce1-4df0-a38e-abdb4942ee72 req-6ebaa41d-48e9-47a8-b72c-522980d126b2 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:01.691212 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-a9f6f107-1ce1-4df0-a38e-abdb4942ee72 req-6ebaa41d-48e9-47a8-b72c-522980d126b2 service nova] Creating event network-vif-deleted:bbd9ba1f-d794-42e2-b153-64ef54f71175 for instance 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d on hv-cinder-85070 Jul 21 23:49:01.697013 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-a9f6f107-1ce1-4df0-a38e-abdb4942ee72 req-6ebaa41d-48e9-47a8-b72c-522980d126b2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035679 Jul 21 23:49:01.697850 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 543/1044] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:49:02.035525 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ae8e5b7b-97ee-493b-837d-96bd4e88a63b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:02.036115 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ae8e5b7b-97ee-493b-837d-96bd4e88a63b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:49:02.042778 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ae8e5b7b-97ee-493b-837d-96bd4e88a63b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:02.043221 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ae8e5b7b-97ee-493b-837d-96bd4e88a63b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:02.043999 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ae8e5b7b-97ee-493b-837d-96bd4e88a63b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:02.044435 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ae8e5b7b-97ee-493b-837d-96bd4e88a63b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:02.078352 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ae8e5b7b-97ee-493b-837d-96bd4e88a63b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:02.079451 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ae8e5b7b-97ee-493b-837d-96bd4e88a63b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:02.079907 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.objects.instance [None req-ae8e5b7b-97ee-493b-837d-96bd4e88a63b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lazy-loading 'fault' on Instance uuid 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d {{(pid=124387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:49:02.122339 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ae8e5b7b-97ee-493b-837d-96bd4e88a63b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26738ea4f6d54d7d81f1ec5057c237ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fb74dd337c49a898397e3482e4305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:49:02.130374 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ae8e5b7b-97ee-493b-837d-96bd4e88a63b tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 200 len: 1230 microversion: 2.1 time: 0.099384 Jul 21 23:49:02.130876 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 502/1045] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:49:02 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:49:03.148094 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-83953d97-620e-441d-94dd-8b6e54c61f0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:03.148786 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-83953d97-620e-441d-94dd-8b6e54c61f0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:49:03.155465 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83953d97-620e-441d-94dd-8b6e54c61f0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:03.155920 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83953d97-620e-441d-94dd-8b6e54c61f0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:03.156675 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83953d97-620e-441d-94dd-8b6e54c61f0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:03.157615 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-83953d97-620e-441d-94dd-8b6e54c61f0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:03.170523 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-83953d97-620e-441d-94dd-8b6e54c61f0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] HTTP exception thrown: Instance 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d could not be found. Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-83953d97-620e-441d-94dd-8b6e54c61f0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Request method failure captured: Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d HTTP/1.1 Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eQDE4Bn1yVu8ksFRIZBWG5R-YqOf9RgdQBoDwsU44y8eTTeU_CWYGBiTUkd6sacxyPTXC9Tnax0ACzxTFyuNjDPlakcdJvVEe6Lm9TwbVbPCWLouUCte_pIPg91BDb1Nh623cefKvBmm85DXJVLisSRxFRy-rf4q1BX2EBaHWeDJFM Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 44fb74dd337c49a898397e3482e4305d Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-TestVolumeBootPattern-57714340 Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:49:03.172101 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44fb74dd337c49a898397e3482e4305d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/44fb74dd337c49a898397e3482e4305d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_44fb74dd337c49a898397e3482e4305d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44fb74dd337c49a898397e3482e4305d"}]}] Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-TestVolumeBootPattern-57714340 Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 44fb74dd337c49a898397e3482e4305d Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-TestVolumeBootPattern-57714340 Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-TestVolumeBootPattern-57714340-project Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 26738ea4f6d54d7d81f1ec5057c237ff Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-TestVolumeBootPattern-57714340-project Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d could not be found. Jul 21 23:49:03.174282 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d'} Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d could not be found. Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:49:03.175268 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d could not be found. Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d could not be found. Jul 21 23:49:03.176908 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.178560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-83953d97-620e-441d-94dd-8b6e54c61f0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Returning 404 to user: Instance 5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:49:03.178560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-83953d97-620e-441d-94dd-8b6e54c61f0e tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d" status: 404 len: 111 microversion: 2.1 time: 0.030596 Jul 21 23:49:03.178560 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 544/1046] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:49:03 2022] GET /compute/v2.1/servers/5087d5c9-f31b-4ce1-99a8-a8c4f3ab119d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:49:03.623160 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-379c98ee-c114-4839-9eaa-ff3d176acb70 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:03.623634 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-379c98ee-c114-4839-9eaa-ff3d176acb70 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:49:03.630304 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-379c98ee-c114-4839-9eaa-ff3d176acb70 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:03.630748 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-379c98ee-c114-4839-9eaa-ff3d176acb70 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:03.631500 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-379c98ee-c114-4839-9eaa-ff3d176acb70 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:03.631931 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-379c98ee-c114-4839-9eaa-ff3d176acb70 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:03.644915 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.wsgi [None req-379c98ee-c114-4839-9eaa-ff3d176acb70 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] HTTP exception thrown: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-379c98ee-c114-4839-9eaa-ff3d176acb70 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Request method failure captured: Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: request: DELETE /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda HTTP/1.1 Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept: application/json Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Accept-Encoding: identity Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Connection: close Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Length: 0 Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Content-Type: application/json Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Host: 10.222.0.57 Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Openstack-System-Scope: None Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: User-Agent: python-urllib3/1.26.9 Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Auth-Token: gAAAAABi2eQDE4Bn1yVu8ksFRIZBWG5R-YqOf9RgdQBoDwsU44y8eTTeU_CWYGBiTUkd6sacxyPTXC9Tnax0ACzxTFyuNjDPlakcdJvVEe6Lm9TwbVbPCWLouUCte_pIPg91BDb1Nh623cefKvBmm85DXJVLisSRxFRy-rf4q1BX2EBaHWeDJFM Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Id: None Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Domain-Name: None Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Identity-Status: Confirmed Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Is-Admin-Project: True Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Id: default Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Domain-Name: Default Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Id: 44fb74dd337c49a898397e3482e4305d Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Project-Name: tempest-TestVolumeBootPattern-57714340 Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Role: reader,member Jul 21 23:49:03.646567 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Roles: reader,member Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44fb74dd337c49a898397e3482e4305d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/44fb74dd337c49a898397e3482e4305d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_44fb74dd337c49a898397e3482e4305d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44fb74dd337c49a898397e3482e4305d"}]}] Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant: tempest-TestVolumeBootPattern-57714340 Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Id: 44fb74dd337c49a898397e3482e4305d Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-Tenant-Name: tempest-TestVolumeBootPattern-57714340 Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User: tempest-TestVolumeBootPattern-57714340-project Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Id: default Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Domain-Name: Default Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Id: 26738ea4f6d54d7d81f1ec5057c237ff Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: X-User-Name: tempest-TestVolumeBootPattern-57714340-project Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: method: > Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: exception: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:49:03.648165 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: action_args: {'id': 'fc1b0372-60fe-4345-9668-12276af08fda'} Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:49:03.649082 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:49:03.650591 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.652130 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-379c98ee-c114-4839-9eaa-ff3d176acb70 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Returning 404 to user: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. {{(pid=124387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:49:03.652130 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-379c98ee-c114-4839-9eaa-ff3d176acb70 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 404 len: 111 microversion: 2.1 time: 0.028618 Jul 21 23:49:03.652130 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 503/1047] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:49:03 2022] DELETE /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:49:03.657606 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d42d5f1c-590b-4713-91a3-93c78ad77587 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:03.658132 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-d42d5f1c-590b-4713-91a3-93c78ad77587 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] [instance: fc1b0372-60fe-4345-9668-12276af08fda] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:49:03.664097 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d42d5f1c-590b-4713-91a3-93c78ad77587 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:03.664571 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d42d5f1c-590b-4713-91a3-93c78ad77587 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:03.665362 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d42d5f1c-590b-4713-91a3-93c78ad77587 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:03.665800 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-d42d5f1c-590b-4713-91a3-93c78ad77587 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:03.679421 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-d42d5f1c-590b-4713-91a3-93c78ad77587 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] HTTP exception thrown: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d42d5f1c-590b-4713-91a3-93c78ad77587 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Request method failure captured: Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda HTTP/1.1 Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eQDE4Bn1yVu8ksFRIZBWG5R-YqOf9RgdQBoDwsU44y8eTTeU_CWYGBiTUkd6sacxyPTXC9Tnax0ACzxTFyuNjDPlakcdJvVEe6Lm9TwbVbPCWLouUCte_pIPg91BDb1Nh623cefKvBmm85DXJVLisSRxFRy-rf4q1BX2EBaHWeDJFM Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 44fb74dd337c49a898397e3482e4305d Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-TestVolumeBootPattern-57714340 Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:49:03.680936 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44fb74dd337c49a898397e3482e4305d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/44fb74dd337c49a898397e3482e4305d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_44fb74dd337c49a898397e3482e4305d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/44fb74dd337c49a898397e3482e4305d"}]}] Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-TestVolumeBootPattern-57714340 Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 44fb74dd337c49a898397e3482e4305d Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-TestVolumeBootPattern-57714340 Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-TestVolumeBootPattern-57714340-project Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 26738ea4f6d54d7d81f1ec5057c237ff Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-TestVolumeBootPattern-57714340-project Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:49:03.682505 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': 'fc1b0372-60fe-4345-9668-12276af08fda'} Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:49:03.683516 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. Jul 21 23:49:03.684959 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:03.686368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-d42d5f1c-590b-4713-91a3-93c78ad77587 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Returning 404 to user: Instance fc1b0372-60fe-4345-9668-12276af08fda could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:49:03.686368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-d42d5f1c-590b-4713-91a3-93c78ad77587 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda" status: 404 len: 111 microversion: 2.1 time: 0.029267 Jul 21 23:49:03.686368 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 545/1048] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:49:03 2022] GET /compute/v2.1/servers/fc1b0372-60fe-4345-9668-12276af08fda => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:49:06.016862 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-1ab7fe32-6dcc-497b-b951-4d81ee77fd68 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] Calling method '.version_select at 0x7f7d28eed310>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:06.036302 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-1ab7fe32-6dcc-497b-b951-4d81ee77fd68 tempest-TestVolumeBootPattern-57714340 tempest-TestVolumeBootPattern-57714340-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1308624493" status: 202 len: 0 microversion: 2.1 time: 0.023882 Jul 21 23:49:06.036877 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 504/1049] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jul 21 23:49:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1308624493 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:49:10.179214 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-5340215a-75cd-4b6e-a3fd-4311eea628d0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:10.180307 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5340215a-75cd-4b6e-a3fd-4311eea628d0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:49:10.187089 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [req-915b5eb9-d5b1-4ab2-997f-bb3e795d0e3a req-9a95a5b1-8e9c-42de-9cf5-3e3b384fb624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cff7cce-773f-4500-af5d-a369509ca64f", "tag": "55de6435-1bbb-4a44-ae52-c711d06bfe75"}]} {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:49:10.187996 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5340215a-75cd-4b6e-a3fd-4311eea628d0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:10.188702 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5340215a-75cd-4b6e-a3fd-4311eea628d0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:10.189761 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5340215a-75cd-4b6e-a3fd-4311eea628d0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:10.190425 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-5340215a-75cd-4b6e-a3fd-4311eea628d0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:10.197978 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-915b5eb9-d5b1-4ab2-997f-bb3e795d0e3a req-9a95a5b1-8e9c-42de-9cf5-3e3b384fb624 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:10.198430 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [req-915b5eb9-d5b1-4ab2-997f-bb3e795d0e3a req-9a95a5b1-8e9c-42de-9cf5-3e3b384fb624 service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:10.211427 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.compute.server_external_events [req-915b5eb9-d5b1-4ab2-997f-bb3e795d0e3a req-9a95a5b1-8e9c-42de-9cf5-3e3b384fb624 service nova] Creating event network-changed:55de6435-1bbb-4a44-ae52-c711d06bfe75 for instance 3cff7cce-773f-4500-af5d-a369509ca64f on hv-cinder-85070 Jul 21 23:49:10.217699 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [req-915b5eb9-d5b1-4ab2-997f-bb3e795d0e3a req-9a95a5b1-8e9c-42de-9cf5-3e3b384fb624 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034158 Jul 21 23:49:10.218538 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 505/1050] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:49:10.226194 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-5340215a-75cd-4b6e-a3fd-4311eea628d0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Going to try to terminate instance {{(pid=124388) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:49:10.362383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-5340215a-75cd-4b6e-a3fd-4311eea628d0 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 204 len: 0 microversion: 2.1 time: 0.186625 Jul 21 23:49:10.364014 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 546/1051] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 23:49:10 2022] DELETE /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:49:10.374181 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-ec8f6a2d-9e2c-4c0e-a53a-207b33e8a410 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:10.374979 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-ec8f6a2d-9e2c-4c0e-a53a-207b33e8a410 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:49:10.382920 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ec8f6a2d-9e2c-4c0e-a53a-207b33e8a410 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:10.383785 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ec8f6a2d-9e2c-4c0e-a53a-207b33e8a410 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:10.385094 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ec8f6a2d-9e2c-4c0e-a53a-207b33e8a410 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:10.385778 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-ec8f6a2d-9e2c-4c0e-a53a-207b33e8a410 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:10.748554 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-ec8f6a2d-9e2c-4c0e-a53a-207b33e8a410 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:49:10.761904 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-ec8f6a2d-9e2c-4c0e-a53a-207b33e8a410 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.393460 Jul 21 23:49:10.762841 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 506/1052] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:49:10 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:49:11.782391 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-0b62e547-32d4-45a2-bef7-096c38c75ad3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:11.783141 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-0b62e547-32d4-45a2-bef7-096c38c75ad3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:49:11.789974 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b62e547-32d4-45a2-bef7-096c38c75ad3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:11.790511 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b62e547-32d4-45a2-bef7-096c38c75ad3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:11.791383 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b62e547-32d4-45a2-bef7-096c38c75ad3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:11.792002 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-0b62e547-32d4-45a2-bef7-096c38c75ad3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:11.936830 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.policy [None req-0b62e547-32d4-45a2-bef7-096c38c75ad3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:49:11.945681 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-0b62e547-32d4-45a2-bef7-096c38c75ad3 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1568 microversion: 2.1 time: 0.168722 Jul 21 23:49:11.947392 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 547/1053] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:49:11 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:49:12.968302 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-867249cf-0c86-4f14-abbc-20b5ec78997d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:12.968920 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.compute.api [None req-867249cf-0c86-4f14-abbc-20b5ec78997d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124387) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:49:12.979095 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-867249cf-0c86-4f14-abbc-20b5ec78997d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:12.979580 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-867249cf-0c86-4f14-abbc-20b5ec78997d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:12.991588 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [req-636f4254-f5ca-4b24-aa7c-14debc0aa2c4 req-a0b3740d-63db-4ebf-88ae-5fa93e50789d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cff7cce-773f-4500-af5d-a369509ca64f", "name": "network-vif-deleted", "tag": "55de6435-1bbb-4a44-ae52-c711d06bfe75"}]} {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:49:12.995949 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-867249cf-0c86-4f14-abbc-20b5ec78997d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:12.997106 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG oslo_concurrency.lockutils [None req-867249cf-0c86-4f14-abbc-20b5ec78997d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:13.008374 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG dbcounter [-] [124387] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:13.010845 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-636f4254-f5ca-4b24-aa7c-14debc0aa2c4 req-a0b3740d-63db-4ebf-88ae-5fa93e50789d service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:13.012127 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [req-636f4254-f5ca-4b24-aa7c-14debc0aa2c4 req-a0b3740d-63db-4ebf-88ae-5fa93e50789d service nova] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:13.042604 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.compute.server_external_events [req-636f4254-f5ca-4b24-aa7c-14debc0aa2c4 req-a0b3740d-63db-4ebf-88ae-5fa93e50789d service nova] Creating event network-vif-deleted:55de6435-1bbb-4a44-ae52-c711d06bfe75 for instance 3cff7cce-773f-4500-af5d-a369509ca64f on hv-cinder-85070 Jul 21 23:49:13.065110 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [req-636f4254-f5ca-4b24-aa7c-14debc0aa2c4 req-a0b3740d-63db-4ebf-88ae-5fa93e50789d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075613 Jul 21 23:49:13.066047 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 548/1054] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 23:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:49:13.119360 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.policy [None req-867249cf-0c86-4f14-abbc-20b5ec78997d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '974e560b80084538929507528d1ea9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46779b270a484e19a7d9ede6406106d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:49:13.128865 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-867249cf-0c86-4f14-abbc-20b5ec78997d tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 200 len: 1381 microversion: 2.1 time: 0.164712 Jul 21 23:49:13.130488 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 507/1055] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:49:12 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 1381 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:49:14.147189 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ce79c40b-23f5-4cfe-9da8-0423bbb0ee7b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '>' {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:14.147967 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.compute.api [None req-ce79c40b-23f5-4cfe-9da8-0423bbb0ee7b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] [instance: 3cff7cce-773f-4500-af5d-a369509ca64f] Fetching instance by UUID {{(pid=124388) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:49:14.154839 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce79c40b-23f5-4cfe-9da8-0423bbb0ee7b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:14.155288 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce79c40b-23f5-4cfe-9da8-0423bbb0ee7b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:14.156057 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce79c40b-23f5-4cfe-9da8-0423bbb0ee7b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:49:14.156491 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG oslo_concurrency.lockutils [None req-ce79c40b-23f5-4cfe-9da8-0423bbb0ee7b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Lock "4f2fb103-b053-4673-9a59-2784203907e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:49:14.171699 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.wsgi [None req-ce79c40b-23f5-4cfe-9da8-0423bbb0ee7b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] HTTP exception thrown: Instance 3cff7cce-773f-4500-af5d-a369509ca64f could not be found. Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ce79c40b-23f5-4cfe-9da8-0423bbb0ee7b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Request method failure captured: Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: request: GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f HTTP/1.1 Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept: application/json Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Accept-Encoding: identity Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Connection: close Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Length: 0 Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Content-Type: application/json Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Host: 10.222.0.57 Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Openstack-System-Scope: None Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: User-Agent: python-urllib3/1.26.9 Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Auth-Token: gAAAAABi2eTbW_lR-ASpBTwN4_DTNrM8LDkQPZ4MUvCdB65ZhshuOYiwR2bk9LTJwKN0XVl5spw4AfY4nSSERbO7TxRcFHNROJaPybKSiUX1iqBBAOFjMwwO0z3i6-uyVIb-wILcLBbF1uBrx8Bz7oCehSkOdopTd-ild9fkgFVo5dW4f1-JjS0 Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Id: None Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Domain-Name: None Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Identity-Status: Confirmed Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Is-Admin-Project: True Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Id: default Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Domain-Name: Default Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Id: 46779b270a484e19a7d9ede6406106d2 Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Project-Name: tempest-TestShelveInstance-1805473422 Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Role: reader,member Jul 21 23:49:14.174005 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Roles: reader,member Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/46779b270a484e19a7d9ede6406106d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/46779b270a484e19a7d9ede6406106d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_46779b270a484e19a7d9ede6406106d2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/46779b270a484e19a7d9ede6406106d2"}]}] Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant: tempest-TestShelveInstance-1805473422 Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Id: 46779b270a484e19a7d9ede6406106d2 Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-Tenant-Name: tempest-TestShelveInstance-1805473422 Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User: tempest-TestShelveInstance-1805473422-project Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Id: default Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Domain-Name: Default Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Id: 974e560b80084538929507528d1ea9de Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: X-User-Name: tempest-TestShelveInstance-1805473422-project Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: method: > Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: exception: Instance 3cff7cce-773f-4500-af5d-a369509ca64f could not be found. Jul 21 23:49:14.175653 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: action_args: {'id': '3cff7cce-773f-4500-af5d-a369509ca64f'} Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: {{(pid=124388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cff7cce-773f-4500-af5d-a369509ca64f could not be found. Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:49:14.176678 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cff7cce-773f-4500-af5d-a369509ca64f could not be found. Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cff7cce-773f-4500-af5d-a369509ca64f could not be found. Jul 21 23:49:14.178227 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: ERROR nova.api.openstack.wsgi Jul 21 23:49:14.179632 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: DEBUG nova.api.openstack.wsgi [None req-ce79c40b-23f5-4cfe-9da8-0423bbb0ee7b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Returning 404 to user: Instance 3cff7cce-773f-4500-af5d-a369509ca64f could not be found. {{(pid=124388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:49:14.179632 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO nova.api.openstack.requestlog [None req-ce79c40b-23f5-4cfe-9da8-0423bbb0ee7b tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f" status: 404 len: 111 microversion: 2.1 time: 0.032801 Jul 21 23:49:14.179632 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: [pid: 124388|app: 0|req: 549/1056] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 23:49:14 2022] GET /compute/v2.1/servers/3cff7cce-773f-4500-af5d-a369509ca64f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:49:14.360139 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: DEBUG nova.api.openstack.wsgi [None req-8baa25fe-b12f-4f63-a40f-c3c90ea8d7d5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] Calling method '.version_select at 0x7f7d28cb0d30>' {{(pid=124387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:49:14.383678 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO nova.api.openstack.requestlog [None req-8baa25fe-b12f-4f63-a40f-c3c90ea8d7d5 tempest-TestShelveInstance-1805473422 tempest-TestShelveInstance-1805473422-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-48017992" status: 202 len: 0 microversion: 2.1 time: 0.027634 Jul 21 23:49:14.384626 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: [pid: 124387|app: 0|req: 508/1057] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 23:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-48017992 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:50:24.650029 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:50:24.650679 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Thu Jul 21 23:50:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:51:54.564362 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:51:54.564968 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Thu Jul 21 23:51:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:52:08.049580 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:52:08.050142 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Thu Jul 21 23:52:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:52:25.126415 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:52:25.126996 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Thu Jul 21 23:52:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:53:44.660183 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:53:44.660907 dv-cinder-850700-1-iscsi devstack@n-api.service[124388]: Thu Jul 21 23:53:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:53:46.482213 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:53:46.482760 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Thu Jul 21 23:53:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:54:13.166182 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:54:13.166810 dv-cinder-850700-1-iscsi devstack@n-api.service[124387]: Thu Jul 21 23:54:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!